Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72597) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72597) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72597) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:45:26 devstack cinder-volume[72597]: INFO dbcounter [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Registered counter for database cinder
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG dbcounter [-] [72597] Writer thread running {{(pid=72597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 06 16:45:26 devstack cinder-volume[72597]: INFO cinder.rpc [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 06 16:45:26 devstack cinder-volume[72597]: INFO cinder.rpc [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:45:26 devstack cinder-volume[72597]: INFO cinder.volume.manager [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Determined volume DB was empty at startup.
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG cinder.volume.manager [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72597) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 06 16:45:26 devstack cinder-volume[72597]: INFO cinder.volume.manager [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 06 16:45:26 devstack cinder-volume[72597]: WARNING stevedore.named [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 06 16:45:26 devstack cinder-volume[72597]: WARNING castellan.key_manager [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:45:26 devstack cinder-volume[72597]: WARNING cinder.keymgr.conf_key_mgr [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG cinder.volume.drivers.lvm [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72597) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 06 16:45:26 devstack cinder-volume[72597]: DEBUG oslo_concurrency.processutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_concurrency.processutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.209s {{(pid=72597) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:45:27 devstack cinder-volume[72597]: INFO cinder.rpc [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 06 16:45:27 devstack cinder-volume[72597]: INFO cinder.rpc [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 06 16:45:27 devstack cinder-volume[72597]: WARNING stevedore.named [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 06 16:45:27 devstack cinder-volume[72597]: WARNING castellan.key_manager [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:45:27 devstack cinder-volume[72597]: INFO cinder.volume.manager [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:45:27 devstack cinder-volume[72597]: INFO oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Starting 1 workers
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Started child 72703 {{(pid=72597) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Full set of CONF: {{(pid=72597) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] ******************************************************************************** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Configuration options gathered from: {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] ================================================================================ {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] allow_availability_zone_fallback = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] allow_compression_on_image_upload = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] allowed_direct_url_schemes     = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] api_rate_limit                 = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] auth_strategy                  = keystone {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] az_cache_duration              = 3600 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_availability_zone      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_host                   = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_name                   = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_stats_polling_interval = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backup_api_class               = cinder.backup.api.API {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backup_name_template           = backup-%s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backup_use_same_host           = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backup_use_temp_snapshot       = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] chap_password                  = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] chap_username                  =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_internal_tenant_project_id = 286d106a80c44a6aa521c904fb2c323f {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_internal_tenant_user_id = d653c957032244f7a687e7dad5fc741f {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cloned_volume_same_az          = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cluster                        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] compression_format             = gzip {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] config_dir                     = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] config_source                  = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] control_exchange               = openstack {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] debug                          = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] default_availability_zone      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] default_group_type             = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] default_volume_type            = lvmdriver-1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] disk_geometry                  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] driver_client_cert             = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] driver_client_cert_key         = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] driver_data_namespace          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] driver_ssl_cert_path           = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72703]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] driver_ssl_cert_verify         = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] driver_use_ssl                 = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] enable_force_upload            = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] enable_new_services            = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] enable_unsupported_driver      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] enforce_multipath_for_image_xfer = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] filter_function                = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_api_insecure            = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_api_servers             = ['http://192.168.122.28/image'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_api_ssl_compression     = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_ca_certificates_file    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_certfile                = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_keyfile                 = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_num_retries             = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance_request_timeout         = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] goodness_function              = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] graceful_shutdown_timeout      = 5 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] group_api_class                = cinder.group.api.API {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] host                           = devstack {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_compress_on_upload       = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_conversion_address_space_limit = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_conversion_cpu_limit     = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_conversion_disable       = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_upload_use_cinder_backend = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_upload_use_internal_tenant = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_volume_cache_enabled     = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_volume_cache_max_count   = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] image_volume_cache_max_size_gb = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] init_host_max_objects_retrieval = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] iscsi_target_flags             =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] iscsi_write_cache              = on {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] iser_helper                    = tgtadm {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] iser_ip_address                = 192.168.122.28 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] iser_port                      = 3260 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_color                      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_config_append              = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_dir                        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_file                       = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_options                    = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72703]: INFO cinder.volume.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_rotate_interval            = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_rotate_interval_type       = days {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] log_rotation_type              = none {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] max_age                        = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] max_logfile_count              = 30 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] max_logfile_size_mb            = 200 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] max_over_subscription_ratio    = 20.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] message_reap_interval          = 86400 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] message_ttl                    = 2592000 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] migration_create_volume_timeout_secs = 300 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] monkey_patch                   = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] monkey_patch_modules           = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] my_ip                          = 192.168.122.28 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] no_snapshot_gb_quota           = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] num_iser_scan_tries            = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] num_shell_tries                = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] num_volume_device_scan_tries   = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] nvmeof_conn_info_version       = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] nvmet_ns_id                    = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] nvmet_port_id                  = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_max_limit                = 1000 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_volume_ext_list          = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_volume_listen_port       = 8776 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_volume_use_ssl           = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] osapi_volume_workers           = 2 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] per_volume_size_limit          = -1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] periodic_fuzzy_delay           = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] periodic_interval              = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] public_endpoint                = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] publish_errors                 = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_backup_gigabytes         = 1000 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_backups                  = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_gigabytes                = 1000 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_groups                   = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_snapshots                = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] quota_volumes                  = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] rate_limit_burst               = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] rate_limit_except_level        = CRITICAL {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] rate_limit_interval            = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] reinit_driver_count            = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] replication_device             = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] report_discard_supported       = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] report_interval                = 120 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] reservation_clean_interval     = 86400 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] reservation_expire             = 86400 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] reserved_image_namespaces      = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] reserved_percentage            = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] rpc_response_timeout           = 120 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] run_external_periodic_tasks    = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] scst_target_driver             = iscsi {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] scst_target_iqn_name           = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_down_time              = 720 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] shell_completion               = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] snapshot_name_template         = snapshot-%s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] snapshot_same_host             = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] split_loggers                  = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] state_path                     = /opt/stack/data/cinder {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] storage_availability_zone      = nova {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] storage_protocol               = iSCSI {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] syslog_log_facility            = LOG_USER {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] target_helper                  = lioadm {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] target_ip_address              = 192.168.122.28 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] target_port                    = 3260 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] target_protocol                = iscsi {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] target_secondary_ip_addresses  = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] trace_flags                    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] transport_url                  = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] until_refresh                  = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_chap_auth                  = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_default_quota_class        = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_journal                    = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_json                       = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_multipath_for_image_xfer   = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_stderr                     = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] use_syslog                     = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] verify_glance_signatures       = enabled {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_api_class               = cinder.volume.api.API {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_backend_name            = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_clear                   = zero {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_clear_ionice            = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_clear_size              = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_copy_bps_limit          = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_dd_blocksize            = 1M {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_name_template           = volume-%s {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_service_inithost_offload = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volume_usage_audit_period      = month {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] zoning_mode                    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_concurrency.disable_process_locking = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.admin_password = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.admin_token = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.admin_user  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_protocol = https {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_section = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_type   = password {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_uri    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.auth_version = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.cache       = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.certfile    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.identity_uri = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.include_service_catalog = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.insecure    = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.interface   = public {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.keyfile     = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_password =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcache_username =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.region_name = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.service_type = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.backend                  = dogpile.cache.null {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.backend_argument         = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.backend_expiration_time  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.config_prefix            = cache.oslo {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.debug_cache_backend      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.enable_retry_client      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.enable_socket_keepalive  = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.enabled                  = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.enforce_fips_mode        = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.expiration_time          = 600 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.hashclient_retry_attempts = 2 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_dead_retry      = 300 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_sasl_enabled    = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.password                 = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.proxies                  = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.redis_db                 = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.redis_server             = localhost:6379 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.retry_attempts           = 2 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.retry_delay              = 0.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.socket_keepalive_count   = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.socket_keepalive_idle    = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.socket_keepalive_interval = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.socket_timeout           = 1.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.tls_allowed_ciphers      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.tls_cafile               = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.tls_certfile             = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.tls_enabled              = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.tls_keyfile              = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cache.username                 = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] coordination.backend_url       = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.asyncio_connection    = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.asyncio_slave_connection = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.backend               = sqlalchemy {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.connection            = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.connection_debug      = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.connection_parameters =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.connection_recycle_time = 3600 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack sudo[72713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.connection_trace      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.db_inc_retry_interval = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.db_max_retries        = 20 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.db_max_retry_interval = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.db_retry_interval     = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack sudo[72713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.max_overflow          = 50 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.max_pool_size         = 5 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.max_retries           = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.mysql_wsrep_sync_wait = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.pool_timeout          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.retry_interval        = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.slave_connection      = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.sqlite_synchronous    = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.synchronous_reader    = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] database.use_db_reconnect      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.connection_string     = messaging:// {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.enabled               = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.es_doc_type           = notification {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.es_scroll_size        = 10000 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.es_scroll_time        = 2m {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.filter_error_trace    = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.hmac_keys             = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.sentinel_service_name = mymaster {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.socket_timeout        = 0.1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.trace_requests        = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler.trace_sqlalchemy      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler_jaeger.process_tags   = {} {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler_jaeger.service_name_prefix = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] profiler_otlp.service_name_prefix = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.enforce_new_defaults = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: WARNING oslo_config.cfg [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.enforce_scope      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.policy_default_rule = default {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.group          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.helper_command = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] privsep_osbrick.user           = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.group         = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.helper_command = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] cinder_sys_admin.user          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.auth_section      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.auth_type         = password {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.cafile            = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.certfile          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.collect_timing    = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.insecure          = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.keyfile           = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.send_service_user_token = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.split_loggers     = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] service_user.timeout           = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.auth_section            = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.auth_type               = password {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.certfile                = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.collect_timing          = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.insecure                = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.keyfile                 = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.region_name             = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.split_loggers           = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] glance.timeout                 = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.backend_availability_zone = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.chap_password = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.chap_username =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.disk_geometry = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.driver_client_cert = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.driver_client_cert_key = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.driver_data_namespace = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.driver_use_ssl = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.extra_capabilities = {} {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.filter_function = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.goodness_function = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.iscsi_target_flags =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.iscsi_write_cache = on {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.iser_port     = 3260 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.lvm_share_target = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.lvm_type      = auto {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.num_shell_tries = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.replication_device = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.report_discard_supported = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.reserved_percentage = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.target_helper = tgtadm {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.target_port   = 3260 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.target_protocol = iscsi {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.trace_flags   = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.unique_fqdn_network = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.use_chap_auth = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_backend_name = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_clear  = zero {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_clear_ionice = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_clear_size = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_reports.file_event_handler = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_reports.log_dir           = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.backend_host       = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.chap_password      = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.chap_username      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.disk_geometry      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.driver_client_cert = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.extra_capabilities = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.filter_function    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.goodness_function  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.iser_helper        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.iser_port          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.lvm_type           = auto {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.replication_device = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.report_discard_supported = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.reserved_percentage = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.scst_target_driver = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.storage_protocol   = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.target_ip_address  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.target_port        = 3260 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.trace_flags        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_clear       = zero {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] lvmdriver-1.volumes_dir        = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_notifications.driver = [] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_notifications.retry = -1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] key_manager.fixed_key          = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.barbican_api_version  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.barbican_endpoint     = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.barbican_endpoint_type = public {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.barbican_region_name  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.cafile                = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.certfile              = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.collect_timing        = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.insecure              = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.keyfile               = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.number_of_retries     = 60 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.retry_delay           = 1 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.send_service_user_token = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.split_loggers         = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.timeout               = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.verify_ssl            = True {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican.verify_ssl_path       = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.auth_section = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.auth_type = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.cafile   = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.certfile = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.collect_timing = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.insecure = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.keyfile  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.split_loggers = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] barbican_service_user.timeout  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.approle_role_id          = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.approle_secret_id        = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.kv_mountpoint            = secret {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.kv_path                  = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.kv_version               = 2 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.namespace                = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.root_token_id            = **** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.ssl_ca_crt_file          = None {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.timeout                  = 60.0 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.use_ssl                  = False {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:45:27 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] ******************************************************************************** {{(pid=72597) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 06 16:45:27 devstack sudo[72713]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.538s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:27 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:27 devstack sudo[72780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:27 devstack sudo[72780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:28 devstack sudo[72780]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:28 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.545s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:28 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:45:28 devstack cinder-volume[72703]: INFO cinder.brick.local_dev.lvm [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 06 16:45:28 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:28 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:28 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:28 devstack sudo[73021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:45:28 devstack sudo[73021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:29 devstack sudo[73021]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:29 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:29 devstack cinder-volume[72703]: DEBUG cinder.brick.local_dev.lvm [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72703) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 06 16:45:29 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:29 devstack sudo[73201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:29 devstack sudo[73201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:30 devstack sudo[73201]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.989s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:30 devstack sudo[73399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:30 devstack sudo[73399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:30 devstack sudo[73399]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:30 devstack sudo[73403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 06 16:45:30 devstack sudo[73403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:30 devstack sudo[73403]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.440s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:30 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:30 devstack sudo[73406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:45:30 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:31 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:31 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:31 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:31 devstack sudo[73414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:45:31 devstack sudo[73414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:31 devstack sudo[73414]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:31 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:31 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:31 devstack sudo[73417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:31 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:32 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:32 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:32 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:32 devstack sudo[73422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:32 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:32 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:32 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:32 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:32 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:32 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:32 devstack sudo[73426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:32 devstack sudo[73426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:33 devstack sudo[73426]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:33 devstack cinder-volume[72703]: INFO cinder.volume.drivers.lvm [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:33 devstack sudo[73437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:33 devstack sudo[73437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:33 devstack sudo[73437]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.559s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG cinder.volume.drivers.lvm [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Updating volume stats {{(pid=72703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 06 16:45:33 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:33 devstack sudo[73553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:45:33 devstack sudo[73553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:34 devstack sudo[73553]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:34 devstack sudo[73557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:34 devstack sudo[73557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:34 devstack sudo[73557]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:34 devstack sudo[73674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:34 devstack sudo[73674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:34 devstack sudo[73674]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.418s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:34 devstack sudo[73698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:34 devstack sudo[73698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:35 devstack sudo[73698]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.409s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:35 devstack cinder-volume[72703]: INFO cinder.volume.driver [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Driver hasn't implemented _init_vendor_properties()
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG cinder.volume.driver [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72703) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG oslo_db.sqlalchemy.engines [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72703) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG dbcounter [-] [72703] Writer thread running {{(pid=72703) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG cinder.db.sqlalchemy.api [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Building query based on filter {{(pid=72703) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG cinder.image.image_utils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72703) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 06 16:45:35 devstack cinder-volume[72703]: INFO cinder.keymgr.migration [None req-cedd2279-d1c2-47a9-98aa-4a555f10c64f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG cinder.volume.drivers.lvm [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Updating volume stats {{(pid=72703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:35 devstack sudo[73706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:45:35 devstack sudo[73706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:35 devstack sudo[73706]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.406s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:35 devstack sudo[73709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:35 devstack sudo[73709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:36 devstack sudo[73709]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:36 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:36 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:36 devstack sudo[73712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:36 devstack sudo[73712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:36 devstack sudo[73712]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:36 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:36 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:36 devstack sudo[73716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:36 devstack sudo[73716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:37 devstack sudo[73716]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG cinder.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Notifying Schedulers of capabilities ... {{(pid=72703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:45:37 devstack cinder-volume[72703]: INFO cinder.volume.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Driver initialization completed successfully.
Apr 06 16:45:37 devstack cinder-volume[72703]: INFO cinder.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Initiating service 2 cleanup
Apr 06 16:45:37 devstack cinder-volume[72703]: INFO cinder.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Service 2 cleanup completed.
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG cinder.service [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Creating RPC server for service cinder-volume {{(pid=72703) start /opt/stack/cinder/cinder/service.py:231}}
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG cinder.service [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72703) start /opt/stack/cinder/cinder/service.py:237}}
Apr 06 16:45:37 devstack cinder-volume[72597]: DEBUG dbcounter [-] [72597] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72597) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:45:37 devstack cinder-volume[72703]: INFO cinder.volume.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG cinder.volume.drivers.lvm [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Updating volume stats {{(pid=72703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:37 devstack sudo[73724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:45:37 devstack sudo[73724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:37 devstack sudo[73724]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:37 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:37 devstack sudo[73728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:37 devstack sudo[73728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:38 devstack sudo[73728]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:38 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:38 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:38 devstack sudo[73733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:45:38 devstack sudo[73733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:38 devstack sudo[73733]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:38 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:38 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:45:38 devstack sudo[73736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:45:38 devstack sudo[73736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:45:39 devstack sudo[73736]: pam_unix(sudo:session): session closed for user root
Apr 06 16:45:39 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:45:39 devstack cinder-volume[72703]: INFO cinder.volume.manager [None req-694688ab-c85a-41d1-ad49-99bfa3a58035 None None] Driver post RPC initialization completed successfully.
Apr 06 16:45:47 devstack cinder-volume[72703]: DEBUG dbcounter [-] [72703] Writing DB stats cinder:SELECT=3 {{(pid=72703) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:45:49 devstack cinder-volume[72703]: DEBUG dbcounter [-] [72703] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72703) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:46:34 devstack cinder-volume[72703]: DEBUG oslo_service.periodic_task [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:46:34 devstack cinder-volume[72703]: DEBUG cinder.volume.drivers.lvm [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Updating volume stats {{(pid=72703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 06 16:46:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:46:34 devstack sudo[77901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:46:34 devstack sudo[77901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:46:34 devstack sudo[77901]: pam_unix(sudo:session): session closed for user root
Apr 06 16:46:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:46:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:46:34 devstack sudo[78246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:46:34 devstack sudo[78246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:46:35 devstack sudo[78246]: pam_unix(sudo:session): session closed for user root
Apr 06 16:46:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:46:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:46:35 devstack sudo[78476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:46:35 devstack sudo[78476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:46:35 devstack sudo[78476]: pam_unix(sudo:session): session closed for user root
Apr 06 16:46:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.425s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:46:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:46:35 devstack sudo[78519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:46:35 devstack sudo[78519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:46:35 devstack sudo[78519]: pam_unix(sudo:session): session closed for user root
Apr 06 16:46:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:46:35 devstack cinder-volume[72703]: DEBUG cinder.manager [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Notifying Schedulers of capabilities ... {{(pid=72703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:47:34 devstack cinder-volume[72703]: DEBUG oslo_service.periodic_task [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:47:34 devstack cinder-volume[72703]: DEBUG cinder.volume.drivers.lvm [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Updating volume stats {{(pid=72703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 06 16:47:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:47:34 devstack sudo[79346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:47:34 devstack sudo[79346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:47:34 devstack sudo[79346]: pam_unix(sudo:session): session closed for user root
Apr 06 16:47:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:47:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:47:34 devstack sudo[79466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:47:34 devstack sudo[79466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:47:35 devstack sudo[79466]: pam_unix(sudo:session): session closed for user root
Apr 06 16:47:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.407s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:47:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:47:35 devstack sudo[79481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:47:35 devstack sudo[79481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:47:35 devstack sudo[79481]: pam_unix(sudo:session): session closed for user root
Apr 06 16:47:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.403s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:47:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:47:35 devstack sudo[79522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:47:35 devstack sudo[79522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:47:35 devstack sudo[79522]: pam_unix(sudo:session): session closed for user root
Apr 06 16:47:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.410s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:47:35 devstack cinder-volume[72703]: DEBUG cinder.manager [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Notifying Schedulers of capabilities ... {{(pid=72703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:47:49 devstack cinder-volume[72703]: DEBUG dbcounter [-] [72703] Writing DB stats cinder:SELECT=1 {{(pid=72703) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:47:49 devstack cinder-volume[72703]: DEBUG dbcounter [-] [72703] Writing DB stats cinder:UPDATE=1 {{(pid=72703) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG oslo_service.periodic_task [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72703) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG cinder.volume.drivers.lvm [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Updating volume stats {{(pid=72703) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:48:34 devstack sudo[81284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 06 16:48:34 devstack sudo[81284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:48:34 devstack sudo[81284]: pam_unix(sudo:session): session closed for user root
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.397s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:48:34 devstack sudo[81288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:48:34 devstack sudo[81288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:48:34 devstack sudo[81288]: pam_unix(sudo:session): session closed for user root
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:48:34 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:48:34 devstack sudo[81302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 06 16:48:34 devstack sudo[81302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:48:35 devstack sudo[81302]: pam_unix(sudo:session): session closed for user root
Apr 06 16:48:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.394s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:48:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:48:35 devstack sudo[81305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 06 16:48:35 devstack sudo[81305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:48:35 devstack sudo[81305]: pam_unix(sudo:session): session closed for user root
Apr 06 16:48:35 devstack cinder-volume[72703]: DEBUG oslo_concurrency.processutils [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=72703) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:48:35 devstack cinder-volume[72703]: DEBUG cinder.manager [None req-a9346440-4605-4339-a97d-07dbe8785e74 None None] Notifying Schedulers of capabilities ... {{(pid=72703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:48:56 devstack cinder-volume[72597]: INFO oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Caught SIGTERM, stopping children
Apr 06 16:48:56 devstack cinder-volume[72597]: DEBUG oslo_concurrency.lockutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Acquiring lock "singleton_lock" {{(pid=72597) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:48:56 devstack cinder-volume[72597]: DEBUG oslo_concurrency.lockutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Acquired lock "singleton_lock" {{(pid=72597) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:48:56 devstack cinder-volume[72597]: DEBUG oslo_concurrency.lockutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Releasing lock "singleton_lock" {{(pid=72597) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:48:56 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Stop services. {{(pid=72597) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 06 16:48:56 devstack cinder-volume[72597]: DEBUG oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Killing children. {{(pid=72597) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 06 16:48:56 devstack cinder-volume[72597]: INFO oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Waiting on 1 children to exit
Apr 06 16:48:57 devstack cinder-volume[72703]: DEBUG oslo_concurrency.lockutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Acquiring lock "singleton_lock" {{(pid=72703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:48:57 devstack cinder-volume[72703]: DEBUG oslo_concurrency.lockutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Acquired lock "singleton_lock" {{(pid=72703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:48:57 devstack cinder-volume[72703]: DEBUG oslo_concurrency.lockutils [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Releasing lock "singleton_lock" {{(pid=72703) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:48:57 devstack cinder-volume[72703]: WARNING amqp [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 06 16:48:57 devstack cinder-volume[72703]: WARNING amqp [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 06 16:48:57 devstack cinder-volume[72597]: INFO oslo_service.backend._eventlet.service [None req-bb18be09-1e8d-425f-9ce0-10b4d5bb2ef2 None None] Child 72703 exited with status 0
Apr 06 16:48:59 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:48:59 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:48:59 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO dbcounter [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Registered counter for database cinder
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_db.sqlalchemy.engines [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG dbcounter [-] [81916] Writer thread running {{(pid=81916) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO cinder.rpc [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO cinder.rpc [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_db.sqlalchemy.engines [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO cinder.volume.manager [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Determined volume DB was empty at startup.
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG cinder.volume.manager [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81916) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO cinder.volume.manager [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 06 16:49:00 devstack cinder-volume[81916]: WARNING stevedore.named [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 06 16:49:00 devstack cinder-volume[81916]: WARNING castellan.key_manager [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:49:00 devstack cinder-volume[81916]: WARNING cinder.keymgr.conf_key_mgr [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO cinder.volume.manager [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_db.sqlalchemy.engines [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:00 devstack cinder-volume[81916]: INFO oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Starting 1 workers
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Started child 82036 {{(pid=81916) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Full set of CONF: {{(pid=81916) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] ******************************************************************************** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Configuration options gathered from: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] ================================================================================ {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 06 16:49:00 devstack cinder-volume[82036]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] allow_availability_zone_fallback = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] allow_compression_on_image_upload = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] allowed_direct_url_schemes     = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] api_rate_limit                 = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] auth_strategy                  = keystone {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_availability_zone      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_host                   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_name                   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_stats_polling_interval = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backup_api_class               = cinder.backup.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backup_name_template           = backup-%s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backup_use_same_host           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backup_use_temp_snapshot       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] chap_password                  = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] chap_username                  =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_internal_tenant_project_id = 286d106a80c44a6aa521c904fb2c323f {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_internal_tenant_user_id = d653c957032244f7a687e7dad5fc741f {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cluster                        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] compression_format             = gzip {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] compute_api_class              = cinder.compute.nova.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] config_dir                     = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] config_source                  = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] control_exchange               = openstack {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] debug                          = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] default_availability_zone      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] default_group_type             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] default_volume_type            = QuobyteHD {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] disk_geometry                  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] driver_client_cert             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] driver_client_cert_key         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] driver_data_namespace          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] driver_ssl_cert_path           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] driver_ssl_cert_verify         = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] driver_use_ssl                 = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] enable_new_services            = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] enable_unsupported_driver      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] enabled_backends               = ['QuobyteHD'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] enforce_multipath_for_image_xfer = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] filter_function                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_api_insecure            = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_api_servers             = ['http://192.168.122.28/image'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_api_ssl_compression     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_ca_certificates_file    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_catalog_info            = image:glance:publicURL {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_certfile                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_keyfile                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_num_retries             = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[82036]: INFO cinder.volume.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance_request_timeout         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] goodness_function              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] graceful_shutdown_timeout      = 5 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] group_api_class                = cinder.group.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] host                           = devstack {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.remotefs [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82036) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_compress_on_upload       = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_conversion_address_space_limit = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_conversion_cpu_limit     = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_conversion_disable       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_upload_use_cinder_backend = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_upload_use_internal_tenant = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_volume_cache_enabled     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_volume_cache_max_count   = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] image_volume_cache_max_size_gb = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] init_host_max_objects_retrieval = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] instance_format                = [instance: %(uuid)s]  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] iscsi_target_flags             =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] iscsi_write_cache              = on {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] iser_helper                    = tgtadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] iser_ip_address                = 192.168.122.28 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] iser_port                      = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_color                      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_config_append              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_dir                        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_file                       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_options                    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_rotate_interval            = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_rotate_interval_type       = days {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] log_rotation_type              = none {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] max_age                        = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] max_logfile_count              = 30 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] max_logfile_size_mb            = 200 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] max_over_subscription_ratio    = 20.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] message_reap_interval          = 86400 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] message_ttl                    = 2592000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] migration_create_volume_timeout_secs = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] monkey_patch                   = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] monkey_patch_modules           = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] my_ip                          = 192.168.122.28 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] no_snapshot_gb_quota           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] num_iser_scan_tries            = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] num_shell_tries                = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] num_volume_device_scan_tries   = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] nvmeof_conn_info_version       = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] nvmet_ns_id                    = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] nvmet_port_id                  = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_max_limit                = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_volume_ext_list          = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_volume_listen_port       = 8776 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_volume_use_ssl           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] osapi_volume_workers           = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] per_volume_size_limit          = -1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] periodic_fuzzy_delay           = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] periodic_interval              = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] public_endpoint                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] publish_errors                 = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_backup_gigabytes         = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_backups                  = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_gigabytes                = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_groups                   = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_snapshots                = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] quota_volumes                  = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] rate_limit_burst               = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] rate_limit_except_level        = CRITICAL {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] rate_limit_interval            = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] reinit_driver_count            = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] replication_device             = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] report_discard_supported       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] report_interval                = 120 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] reservation_clean_interval     = 86400 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] reservation_expire             = 86400 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] reserved_image_namespaces      = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] reserved_percentage            = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] rpc_response_timeout           = 120 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] run_external_periodic_tasks    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] scst_target_driver             = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] scst_target_iqn_name           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_down_time              = 720 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] shell_completion               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] snapshot_name_template         = snapshot-%s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] split_loggers                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] state_path                     = /opt/stack/data/cinder {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] storage_availability_zone      = nova {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] storage_protocol               = iSCSI {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] syslog_log_facility            = LOG_USER {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] target_helper                  = lioadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] target_ip_address              = 192.168.122.28 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] target_port                    = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] target_protocol                = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] target_secondary_ip_addresses  = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] trace_flags                    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] transport_url                  = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] until_refresh                  = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_chap_auth                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_default_quota_class        = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_journal                    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_json                       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_multipath_for_image_xfer   = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_stderr                     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] use_syslog                     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] verify_glance_signatures       = enabled {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_api_class               = cinder.volume.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_backend_name            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_clear                   = zero {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_clear_ionice            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_clear_size              = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_copy_bps_limit          = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_dd_blocksize            = 1M {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_name_template           = volume-%s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_service_inithost_offload = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volume_usage_audit_period      = month {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] zoning_mode                    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82036) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 06 16:49:00 devstack cinder-volume[82036]: WARNING cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 06 16:49:00 devstack cinder-volume[82036]: WARNING cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Running cmd (subprocess): mount.quobyte {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_concurrency.disable_process_locking = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.admin_password = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.admin_token = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.admin_user  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_port   = 35357 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_protocol = https {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_section = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_type   = password {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_uri    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.auth_version = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.cache       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.certfile    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.delay_auth_decision = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.http_connect_timeout = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.identity_uri = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.include_service_catalog = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.insecure    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.interface   = public {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.keyfile     = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_password =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcache_username =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.region_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.service_token_roles_required = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.service_type = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.token_cache_time = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.backend                  = dogpile.cache.null {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.backend_argument         = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.backend_expiration_time  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.config_prefix            = cache.oslo {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.debug_cache_backend      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.enable_retry_client      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.enable_socket_keepalive  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.enabled                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.enforce_fips_mode        = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.expiration_time          = 600 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.hashclient_retry_attempts = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_dead_retry      = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_pool_maxsize    = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_sasl_enabled    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.password                 = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.proxies                  = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.redis_db                 = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.redis_sentinel_service_name = mymaster {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.redis_server             = localhost:6379 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.retry_attempts           = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.retry_delay              = 0.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.socket_keepalive_count   = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.socket_keepalive_idle    = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.socket_keepalive_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.socket_timeout           = 1.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.tls_allowed_ciphers      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.tls_cafile               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.tls_certfile             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.tls_enabled              = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.tls_keyfile              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cache.username                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] coordination.backend_url       = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.asyncio_connection    = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.asyncio_slave_connection = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.backend               = sqlalchemy {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.connection            = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.connection_debug      = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.connection_parameters =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.connection_recycle_time = 3600 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.connection_trace      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.db_inc_retry_interval = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.db_max_retries        = 20 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.db_max_retry_interval = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.db_retry_interval     = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.max_overflow          = 50 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.max_pool_size         = 5 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.max_retries           = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.mysql_wsrep_sync_wait = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.pool_timeout          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.retry_interval        = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.slave_connection      = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.sqlite_synchronous    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.synchronous_reader    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] database.use_db_reconnect      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.connection_string     = messaging:// {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.enabled               = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.es_doc_type           = notification {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.es_scroll_size        = 10000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.es_scroll_time        = 2m {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.filter_error_trace    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.hmac_keys             = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.sentinel_service_name = mymaster {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.socket_timeout        = 0.1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.trace_requests        = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler.trace_sqlalchemy      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler_jaeger.process_tags   = {} {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler_jaeger.service_name_prefix = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] profiler_otlp.service_name_prefix = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.enforce_new_defaults = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: WARNING oslo_config.cfg [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.enforce_scope      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.policy_default_rule = default {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.policy_file        = policy.yaml {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.group          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.helper_command = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] privsep_osbrick.user           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.group         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.helper_command = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] cinder_sys_admin.user          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.auth_section      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.auth_type         = password {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.cafile            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.certfile          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.collect_timing    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.insecure          = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.keyfile           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.send_service_user_token = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.split_loggers     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] service_user.timeout           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.auth_section            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.auth_type               = password {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack quobyte-client[82037]: Reading configuration file: /etc/quobyte/client.cfg
Apr 06 16:49:00 devstack quobyte-client[82037]: Invalid parameters found, error: missing mount point.
Apr 06 16:49:00 devstack quobyte-client[82037]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 06 16:49:00 devstack quobyte-client[82037]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.certfile                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.collect_timing          = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.insecure                = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.keyfile                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.region_name             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.split_loggers           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] glance.timeout                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.backend_availability_zone = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.chap_password = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.chap_username =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.disk_geometry = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.driver_client_cert = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.driver_client_cert_key = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.driver_data_namespace = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.driver_use_ssl = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.enable_unsupported_driver = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.extra_capabilities = {} {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.filter_function = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.goodness_function = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.iscsi_target_flags =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.iscsi_write_cache = on {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.iser_helper   = tgtadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.iser_port     = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: INFO cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 ...
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 -c /etc/quobyte/client-cinder.cfg {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_host      =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_login     = admin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_mount_options = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_password  = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_private_key =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_share_path =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.num_shell_tries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.nvmet_port_id = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_client_cfg = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.quobyte_volume_url = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.replication_device = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.report_discard_supported = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.reserved_percentage = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.scst_target_driver = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.scst_target_iqn_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.storage_protocol = iSCSI {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.target_helper = tgtadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.target_port   = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.target_protocol = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.trace_flags   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.unique_fqdn_network = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.use_chap_auth = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_backend_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_clear  = zero {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_clear_ionice = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_clear_size = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack sudo[82038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 -c /etc/quobyte/client-cinder.cfg
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack sudo[82038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_reports.file_event_handler = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_reports.log_dir           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.backend_availability_zone = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.backend_host         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.chap_password        = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.chap_username        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.chiscsi_conf         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.disk_geometry        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.driver_client_cert   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.driver_client_cert_key = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.driver_data_namespace = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.driver_use_ssl       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.extra_capabilities   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.filter_function      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.goodness_function    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.iser_helper          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.iser_ip_address      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.iser_port            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.iser_target_prefix   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_host             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_login            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_mount_options    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_password         = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_private_key      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_share_path       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_ssh_port         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.num_shell_tries      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.nvmet_port_id        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.replication_device   = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.report_discard_supported = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.reserved_percentage  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.scst_target_driver   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.storage_protocol     = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.target_helper        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.target_ip_address    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.target_port          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.target_prefix        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.target_protocol      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.trace_flags          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.use_chap_auth        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_clear         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_clear_size    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] QuobyteHD.volumes_dir          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.ssl      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_notifications.driver = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_notifications.retry = -1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] oslo_messaging_notifications.transport_url = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] key_manager.fixed_key          = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.barbican_api_version  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.barbican_endpoint     = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.barbican_endpoint_type = public {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.barbican_region_name  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.cafile                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.certfile              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.collect_timing        = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.insecure              = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.keyfile               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.number_of_retries     = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.retry_delay           = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.send_service_user_token = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.split_loggers         = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.timeout               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.verify_ssl            = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican.verify_ssl_path       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.auth_section = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.auth_type = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.cafile   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.certfile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.collect_timing = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.insecure = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.keyfile  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.split_loggers = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] barbican_service_user.timeout  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.approle_role_id          = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.approle_secret_id        = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.kv_mountpoint            = secret {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.kv_path                  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.kv_version               = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.namespace                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.root_token_id            = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.ssl_ca_crt_file          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.timeout                  = 60.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.use_ssl                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:00 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] ******************************************************************************** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 06 16:49:01 devstack sudo[82038]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.462s {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 succeeded
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.469s {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:01 devstack sudo[82107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:49:01 devstack sudo[82107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:01 devstack sudo[82107]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.353s {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.volume.driver [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Driver hasn't implemented _init_vendor_properties()
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.volume.driver [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82036) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_db.sqlalchemy.engines [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG dbcounter [-] [82036] Writer thread running {{(pid=82036) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.db.sqlalchemy.api [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Building query based on filter {{(pid=82036) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.image.image_utils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82036) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.keymgr.migration [None req-1887841a-afc3-4942-9d76-836b730ca427 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:01 devstack sudo[82110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:49:01 devstack sudo[82110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:01 devstack sudo[82110]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.371s {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Notifying Schedulers of capabilities ... {{(pid=82036) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.volume.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Driver initialization completed successfully.
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Initiating service 3 cleanup
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Service 3 cleanup completed.
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.service [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Creating RPC server for service cinder-volume {{(pid=82036) start /opt/stack/cinder/cinder/service.py:231}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.service [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82036) start /opt/stack/cinder/cinder/service.py:237}}
Apr 06 16:49:01 devstack cinder-volume[82036]: INFO cinder.volume.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82036) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG cinder.volume.drivers.quobyte [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82036) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82036) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:49:01 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:01 devstack sudo[82115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:49:01 devstack sudo[82115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:02 devstack sudo[82115]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:02 devstack cinder-volume[82036]: DEBUG oslo_concurrency.processutils [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.399s {{(pid=82036) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:02 devstack cinder-volume[82036]: INFO cinder.volume.manager [None req-d89c7eac-3e9b-4db6-9c91-cf70092d402b None None] Driver post RPC initialization completed successfully.
Apr 06 16:49:04 devstack cinder-volume[81916]: INFO oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Caught SIGTERM, stopping children
Apr 06 16:49:04 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Acquiring lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:49:04 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Acquired lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:49:04 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Releasing lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:49:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Stop services. {{(pid=81916) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 06 16:49:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Killing children. {{(pid=81916) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 06 16:49:04 devstack cinder-volume[81916]: INFO oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Waiting on 1 children to exit
Apr 06 16:49:06 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Acquiring lock "singleton_lock" {{(pid=82036) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:49:06 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Acquired lock "singleton_lock" {{(pid=82036) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:49:06 devstack cinder-volume[82036]: DEBUG oslo_concurrency.lockutils [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Releasing lock "singleton_lock" {{(pid=82036) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:49:06 devstack cinder-volume[82036]: WARNING amqp [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 06 16:49:06 devstack cinder-volume[82036]: WARNING amqp [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 06 16:49:06 devstack cinder-volume[81916]: INFO oslo_service.backend._eventlet.service [None req-a7a59538-b11b-4d55-b583-8e92281d490d None None] Child 82036 exited with status 0
Apr 06 16:49:07 devstack cinder-volume[82256]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 06 16:49:07 devstack cinder-volume[82256]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 06 16:49:07 devstack cinder-volume[82256]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 06 16:49:08 devstack cinder-volume[82256]: INFO dbcounter [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Registered counter for database cinder
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_db.sqlalchemy.engines [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG dbcounter [-] [82256] Writer thread running {{(pid=82256) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 06 16:49:08 devstack cinder-volume[82256]: INFO cinder.rpc [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 06 16:49:08 devstack cinder-volume[82256]: INFO cinder.rpc [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_db.sqlalchemy.engines [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:08 devstack cinder-volume[82256]: INFO cinder.volume.manager [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Determined volume DB was empty at startup.
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG cinder.volume.manager [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82256) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 06 16:49:08 devstack cinder-volume[82256]: WARNING stevedore.named [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 06 16:49:08 devstack cinder-volume[82256]: WARNING castellan.key_manager [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:49:08 devstack cinder-volume[82256]: WARNING cinder.keymgr.conf_key_mgr [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 06 16:49:08 devstack cinder-volume[82256]: INFO cinder.volume.manager [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_db.sqlalchemy.engines [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:08 devstack cinder-volume[82256]: INFO oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Starting 1 workers
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Started child 82421 {{(pid=82256) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Full set of CONF: {{(pid=82256) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] ******************************************************************************** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Configuration options gathered from: {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] ================================================================================ {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] allow_availability_zone_fallback = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] allow_compression_on_image_upload = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] allowed_direct_url_schemes     = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] api_rate_limit                 = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] auth_strategy                  = keystone {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_availability_zone      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_host                   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_name                   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_stats_polling_interval = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backup_api_class               = cinder.backup.api.API {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backup_name_template           = backup-%s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backup_use_same_host           = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backup_use_temp_snapshot       = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] chap_password                  = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] chap_username                  =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_internal_tenant_project_id = 286d106a80c44a6aa521c904fb2c323f {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_internal_tenant_user_id = d653c957032244f7a687e7dad5fc741f {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cluster                        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] compression_format             = gzip {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] config_dir                     = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] config_source                  = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] control_exchange               = openstack {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] debug                          = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] default_availability_zone      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] default_group_type             = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] default_volume_type            = QuobyteHD {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] disk_geometry                  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] driver_client_cert             = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] driver_client_cert_key         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] driver_data_namespace          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] driver_ssl_cert_path           = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] driver_ssl_cert_verify         = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] driver_use_ssl                 = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] enable_new_services            = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] enable_unsupported_driver      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] enforce_multipath_for_image_xfer = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] filter_function                = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_api_insecure            = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_api_servers             = ['http://192.168.122.28/image'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_api_ssl_compression     = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_ca_certificates_file    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_certfile                = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_keyfile                 = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_num_retries             = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance_request_timeout         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] goodness_function              = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] graceful_shutdown_timeout      = 5 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] group_api_class                = cinder.group.api.API {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] host                           = devstack {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_compress_on_upload       = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82421]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_conversion_address_space_limit = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_conversion_cpu_limit     = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_conversion_disable       = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_upload_use_cinder_backend = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_upload_use_internal_tenant = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_volume_cache_enabled     = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_volume_cache_max_count   = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] image_volume_cache_max_size_gb = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] init_host_max_objects_retrieval = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] iscsi_target_flags             =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] iscsi_write_cache              = on {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] iser_helper                    = tgtadm {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] iser_ip_address                = 192.168.122.28 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] iser_port                      = 3260 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_color                      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_config_append              = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_dir                        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_file                       = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_options                    = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_rotate_interval            = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_rotate_interval_type       = days {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] log_rotation_type              = none {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] max_age                        = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] max_logfile_count              = 30 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] max_logfile_size_mb            = 200 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] max_over_subscription_ratio    = 20.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] message_reap_interval          = 86400 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] message_ttl                    = 2592000 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] migration_create_volume_timeout_secs = 300 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] monkey_patch                   = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] monkey_patch_modules           = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] my_ip                          = 192.168.122.28 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] no_snapshot_gb_quota           = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] num_iser_scan_tries            = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] num_shell_tries                = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] num_volume_device_scan_tries   = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] nvmeof_conn_info_version       = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] nvmet_ns_id                    = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] nvmet_port_id                  = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_max_limit                = 1000 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_volume_ext_list          = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_volume_listen_port       = 8776 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_volume_use_ssl           = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] osapi_volume_workers           = 2 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] per_volume_size_limit          = -1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] periodic_fuzzy_delay           = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] periodic_interval              = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] public_endpoint                = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] publish_errors                 = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_backup_gigabytes         = 1000 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_backups                  = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_gigabytes                = 1000 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_groups                   = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_snapshots                = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] quota_volumes                  = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] rate_limit_burst               = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] rate_limit_except_level        = CRITICAL {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] rate_limit_interval            = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] reinit_driver_count            = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] replication_device             = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] report_discard_supported       = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] report_interval                = 120 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] reservation_clean_interval     = 86400 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] reservation_expire             = 86400 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] reserved_image_namespaces      = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] reserved_percentage            = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] rpc_response_timeout           = 120 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] run_external_periodic_tasks    = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] scst_target_driver             = iscsi {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] scst_target_iqn_name           = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_down_time              = 720 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] shell_completion               = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] snapshot_name_template         = snapshot-%s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] split_loggers                  = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] state_path                     = /opt/stack/data/cinder {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] storage_availability_zone      = nova {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] storage_protocol               = iSCSI {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] syslog_log_facility            = LOG_USER {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] target_helper                  = lioadm {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] target_ip_address              = 192.168.122.28 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] target_port                    = 3260 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] target_protocol                = iscsi {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] target_secondary_ip_addresses  = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] trace_flags                    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] transport_url                  = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] until_refresh                  = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_chap_auth                  = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_default_quota_class        = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_journal                    = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_json                       = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_multipath_for_image_xfer   = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_stderr                     = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] use_syslog                     = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] verify_glance_signatures       = enabled {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_api_class               = cinder.volume.api.API {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_backend_name            = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_clear                   = zero {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_clear_ionice            = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_clear_size              = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_copy_bps_limit          = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_dd_blocksize            = 1M {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_name_template           = volume-%s {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_service_inithost_offload = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volume_usage_audit_period      = month {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] zoning_mode                    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_concurrency.disable_process_locking = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.admin_password = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.admin_token = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.admin_user  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_protocol = https {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_section = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_type   = password {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_uri    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.auth_version = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.cache       = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.certfile    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.identity_uri = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.include_service_catalog = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.insecure    = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.interface   = public {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.keyfile     = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_password =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcache_username =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.region_name = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.service_type = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.backend                  = dogpile.cache.null {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.backend_argument         = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.backend_expiration_time  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.config_prefix            = cache.oslo {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.debug_cache_backend      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.enable_retry_client      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.enable_socket_keepalive  = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.enabled                  = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.enforce_fips_mode        = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.expiration_time          = 600 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.hashclient_retry_attempts = 2 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_dead_retry      = 300 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_sasl_enabled    = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.password                 = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.proxies                  = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.redis_db                 = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.redis_server             = localhost:6379 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.retry_attempts           = 2 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.retry_delay              = 0.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.socket_keepalive_count   = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.socket_keepalive_idle    = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.socket_keepalive_interval = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.socket_timeout           = 1.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.tls_allowed_ciphers      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.tls_cafile               = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.tls_certfile             = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.tls_enabled              = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.tls_keyfile              = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cache.username                 = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] coordination.backend_url       = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.asyncio_connection    = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.asyncio_slave_connection = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.backend               = sqlalchemy {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.connection            = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.connection_debug      = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.connection_parameters =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.connection_recycle_time = 3600 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.connection_trace      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.db_inc_retry_interval = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.db_max_retries        = 20 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.db_max_retry_interval = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.db_retry_interval     = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.max_overflow          = 50 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.max_pool_size         = 5 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.max_retries           = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.mysql_wsrep_sync_wait = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.pool_timeout          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.retry_interval        = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.slave_connection      = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.sqlite_synchronous    = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.synchronous_reader    = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] database.use_db_reconnect      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.connection_string     = messaging:// {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.enabled               = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.es_doc_type           = notification {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.es_scroll_size        = 10000 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.es_scroll_time        = 2m {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.filter_error_trace    = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.hmac_keys             = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.sentinel_service_name = mymaster {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.socket_timeout        = 0.1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.trace_requests        = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler.trace_sqlalchemy      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler_jaeger.process_tags   = {} {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler_jaeger.service_name_prefix = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] profiler_otlp.service_name_prefix = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.enforce_new_defaults = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: WARNING oslo_config.cfg [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.enforce_scope      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.policy_default_rule = default {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.group          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.helper_command = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] privsep_osbrick.user           = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.group         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.helper_command = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] cinder_sys_admin.user          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.auth_section      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.auth_type         = password {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.cafile            = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.certfile          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.collect_timing    = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.insecure          = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.keyfile           = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.send_service_user_token = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.split_loggers     = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] service_user.timeout           = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.auth_section            = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.auth_type               = password {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.certfile                = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.collect_timing          = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.insecure                = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.keyfile                 = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.region_name             = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.split_loggers           = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] glance.timeout                 = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.backend_availability_zone = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.chap_password = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.chap_username =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.disk_geometry = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.driver_client_cert = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.driver_client_cert_key = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.driver_data_namespace = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.driver_use_ssl = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.extra_capabilities = {} {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.filter_function = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.goodness_function = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.iscsi_target_flags =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.iscsi_write_cache = on {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.iser_port     = 3260 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_host      =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_login     = admin {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_mount_options = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_password  = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_private_key =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_share_path =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82421) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.num_shell_tries = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.quobyte_volume_url = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.replication_device = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.report_discard_supported = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.reserved_percentage = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.target_helper = tgtadm {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.target_port   = 3260 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.target_protocol = iscsi {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.trace_flags   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.unique_fqdn_network = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.use_chap_auth = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_backend_name = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_clear  = zero {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_clear_ionice = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_clear_size = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_reports.file_event_handler = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_reports.log_dir           = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.backend_availability_zone = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.backend_host         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.chap_password        = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.chap_username        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.disk_geometry        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.driver_client_cert   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.driver_data_namespace = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.extra_capabilities   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.filter_function      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.goodness_function    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.iser_helper          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.iser_ip_address      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.iser_port            = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_host             = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_login            = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_mount_options    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_password         = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_private_key      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_share_path       = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.num_shell_tries      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.replication_device   = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.report_discard_supported = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.reserved_percentage  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.scst_target_driver   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.storage_protocol     = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.target_helper        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.target_ip_address    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.target_port          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.target_prefix        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.target_protocol      = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.trace_flags          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.use_chap_auth        = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_clear         = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_clear_size    = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] QuobyteHD.volumes_dir          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_notifications.driver = [] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_notifications.retry = -1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] key_manager.fixed_key          = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.barbican_api_version  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.barbican_endpoint     = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.barbican_endpoint_type = public {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.barbican_region_name  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.cafile                = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.certfile              = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.collect_timing        = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.insecure              = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.keyfile               = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.number_of_retries     = 60 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.retry_delay           = 1 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.send_service_user_token = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.split_loggers         = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.timeout               = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.verify_ssl            = True {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican.verify_ssl_path       = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.auth_section = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.auth_type = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.cafile   = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.certfile = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.collect_timing = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.insecure = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.keyfile  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.split_loggers = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] barbican_service_user.timeout  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.approle_role_id          = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.approle_secret_id        = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.kv_mountpoint            = secret {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.kv_path                  = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.kv_version               = 2 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.namespace                = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.root_token_id            = **** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.ssl_ca_crt_file          = None {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.timeout                  = 60.0 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.use_ssl                  = False {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 06 16:49:08 devstack cinder-volume[82256]: DEBUG oslo_service.backend._eventlet.service [None req-12097d7c-df04-49e7-bd02-dc8c93b0bd27 None None] ******************************************************************************** {{(pid=82256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 06 16:49:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82421) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 06 16:49:08 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 06 16:49:08 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 06 16:49:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Running cmd (subprocess): mount.quobyte {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:09 devstack quobyte-client[82457]: Reading configuration file: /etc/quobyte/client.cfg
Apr 06 16:49:09 devstack quobyte-client[82457]: Invalid parameters found, error: missing mount point.
Apr 06 16:49:09 devstack quobyte-client[82457]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 06 16:49:09 devstack quobyte-client[82457]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] CMD "mount.quobyte" returned: 1 in 0.046s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:09 devstack sudo[82458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:49:09 devstack sudo[82458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:09 devstack sudo[82458]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.652s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:09 devstack cinder-volume[82421]: INFO cinder.volume.driver [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Driver hasn't implemented _init_vendor_properties()
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.volume.driver [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82421) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_db.sqlalchemy.engines [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writer thread running {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.db.sqlalchemy.api [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Building query based on filter {{(pid=82421) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82421) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:49:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:09 devstack cinder-volume[82421]: INFO cinder.keymgr.migration [None req-c6c3968e-e165-4ace-8448-132abb3c9b3f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 06 16:49:09 devstack sudo[82495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:49:09 devstack sudo[82495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:10 devstack sudo[82495]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.368s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:49:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Driver initialization completed successfully.
Apr 06 16:49:10 devstack cinder-volume[82421]: INFO cinder.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Initiating service 3 cleanup
Apr 06 16:49:10 devstack cinder-volume[82421]: INFO cinder.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Service 3 cleanup completed.
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG cinder.service [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Creating RPC server for service cinder-volume {{(pid=82421) start /opt/stack/cinder/cinder/service.py:231}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG cinder.service [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82421) start /opt/stack/cinder/cinder/service.py:237}}
Apr 06 16:49:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:49:10 devstack sudo[82499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:49:10 devstack sudo[82499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:49:10 devstack sudo[82499]: pam_unix(sudo:session): session closed for user root
Apr 06 16:49:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:49:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-dd9badf0-3240-4882-a37a-6af0a31dfd7c None None] Driver post RPC initialization completed successfully.
Apr 06 16:49:18 devstack cinder-volume[82256]: DEBUG dbcounter [-] [82256] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82256) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:49:20 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:49:20 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=3 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:49:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a0661c9b-9b4c-4a91-b64b-a984eea49ea6 tempest-BackendsCapabilitiesAdminTestsJSON-621058692 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82421) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4840}}
Apr 06 16:49:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-98394cb6-aa6f-4187-958f-720fcc54557d tempest-BackendsCapabilitiesAdminTestsJSON-621058692 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82421) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4840}}
Apr 06 16:50:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3a44c5f9-e2cd-4eaa-9867-293c1191322f tempest-GroupsV314Test-208411527 None] Group tempest-GroupsV314Test-Group-1364826746: creating
Apr 06 16:50:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3a44c5f9-e2cd-4eaa-9867-293c1191322f tempest-GroupsV314Test-208411527 None] Group tempest-GroupsV314Test-Group-1364826746: created successfully
Apr 06 16:50:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3a44c5f9-e2cd-4eaa-9867-293c1191322f tempest-GroupsV314Test-208411527 None] Create group completed successfully.
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Flow 'volume_create_manager' (8ad62380-f2de-4b35-9089-a2d536cbecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a604ddf-7f4a-4c83-b915-e012a94d8c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a604ddf-7f4a-4c83-b915-e012a94d8c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1241094001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe68f8c1-6de4-403c-aeac-3ac255963272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376356a271a04e3ea52ba6040b7d5a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:09Z,use_quota=True,user_id='f598ea77591d40b68a1bf2fac16a995f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64603a54-6887-4bca-8d53-c5db76edd23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64603a54-6887-4bca-8d53-c5db76edd23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fa6c72-9db9-4d56-85e3-a519cffc3fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fa6c72-9db9-4d56-85e3-a519cffc3fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe68f8c1-6de4-403c-aeac-3ac255963272', 'volume_name': 'volume-fe68f8c1-6de4-403c-aeac-3ac255963272', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e08008e-1465-4929-aec2-a801b11f1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e08008e-1465-4929-aec2-a801b11f1591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beb6b3c-e8c0-4353-96f4-21e35b0fb20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Volume fe68f8c1-6de4-403c-aeac-3ac255963272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe68f8c1-6de4-403c-aeac-3ac255963272', 'volume_size': 1}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1241094001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe68f8c1-6de4-403c-aeac-3ac255963272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376356a271a04e3ea52ba6040b7d5a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:09Z,use_quota=True,user_id='f598ea77591d40b68a1bf2fac16a995f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Creating volume fe68f8c1-6de4-403c-aeac-3ac255963272 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:50:09 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:09 devstack sudo[83053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 1073741824
Apr 06 16:50:09 devstack sudo[83053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Flow 'volume_create_manager' (9360386b-06c1-4c54-9c50-7da8f72f9ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7dc1c1-86c8-462c-8483-e993dc968398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7dc1c1-86c8-462c-8483-e993dc968398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2066268254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4dafefd-dbe4-4932-a704-d0f9bfbd01ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61bfdec240d4164ba2a1475e3fda221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:10Z,use_quota=True,user_id='1654c932c2f442e68e1bf960d54d7e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d0c9f0-1eeb-4ea2-b56b-46b623680bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d0c9f0-1eeb-4ea2-b56b-46b623680bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523d7425-4e6a-4e15-9a40-a0db8f22b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523d7425-4e6a-4e15-9a40-a0db8f22b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4dafefd-dbe4-4932-a704-d0f9bfbd01ba', 'volume_name': 'volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21a6344-dbe4-40b0-908f-3f49069dfa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21a6344-dbe4-40b0-908f-3f49069dfa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0916ad3c-a5b8-4721-bd9c-5573bcb1b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Volume a4dafefd-dbe4-4932-a704-d0f9bfbd01ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba', 'volume_size': 1}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Flow 'volume_create_manager' (e7b582ab-f5d2-443f-a5e7-729743191fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fa7488-5c47-4b0c-84a2-68d420aa39a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74fa7488-5c47-4b0c-84a2-68d420aa39a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1292979107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e69cf95-13a6-450c-a12e-676cf1926892,host='devstack@QuobyteHD#QuobyteHD',id=3a56746e-f328-492b-8303-26faa5133eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cad24dec4c74c249d204a2668a1e155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:10Z,use_quota=True,user_id='98fc46b89fe74941b3ab3897e523c4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a267d7c6-4d2d-4a82-8c08-3d4b2db19381),volume_type_id=a267d7c6-4d2d-4a82-8c08-3d4b2db19381)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f241c72c-f1a1-44fb-944a-84c17a311db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f241c72c-f1a1-44fb-944a-84c17a311db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9dc399-b6f7-4c40-942a-514ad53286ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9dc399-b6f7-4c40-942a-514ad53286ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a56746e-f328-492b-8303-26faa5133eab', 'volume_name': 'volume-3a56746e-f328-492b-8303-26faa5133eab', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce24a887-a76f-4a08-b764-94eda578dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce24a887-a76f-4a08-b764-94eda578dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850582de-6479-4c64-a767-bc46db2523ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Volume 3a56746e-f328-492b-8303-26faa5133eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a56746e-f328-492b-8303-26faa5133eab', 'volume_size': 1}
Apr 06 16:50:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:11 devstack sudo[83053]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 1073741824" returned: 0 in 1.874s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:11 devstack sudo[83400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272
Apr 06 16:50:11 devstack sudo[83400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:12 devstack sudo[83400]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272" returned: 0 in 0.820s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] <== create_volume: return (2814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.819s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2066268254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4dafefd-dbe4-4932-a704-d0f9bfbd01ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61bfdec240d4164ba2a1475e3fda221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:10Z,use_quota=True,user_id='1654c932c2f442e68e1bf960d54d7e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Creating volume a4dafefd-dbe4-4932-a704-d0f9bfbd01ba {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:50:12 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:12 devstack sudo[83411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba 1073741824
Apr 06 16:50:12 devstack sudo[83411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1beb6b3c-e8c0-4353-96f4-21e35b0fb20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe68f8c1-6de4-403c-aeac-3ac255963272', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c163a7-ef97-451a-8aa6-2aea040dddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:12 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Volume volume-fe68f8c1-6de4-403c-aeac-3ac255963272 (fe68f8c1-6de4-403c-aeac-3ac255963272): created successfully
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c163a7-ef97-451a-8aa6-2aea040dddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Flow 'volume_create_manager' (8ad62380-f2de-4b35-9089-a2d536cbecd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8cdd0731-0606-4dd9-bbb9-0b23ab2a43aa tempest-DeleteServersTestJSON-1063462737 None] Created volume successfully.
Apr 06 16:50:13 devstack sudo[83411]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba 1073741824" returned: 0 in 0.911s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:13 devstack sudo[83423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba
Apr 06 16:50:13 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:14 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba" returned: 0 in 1.304s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] <== create_volume: return (2304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.273s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8e69cf95-13a6-450c-a12e-676cf1926892,created_at=2026-04-06T14:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1292979107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e69cf95-13a6-450c-a12e-676cf1926892,host='devstack@QuobyteHD#QuobyteHD',id=3a56746e-f328-492b-8303-26faa5133eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cad24dec4c74c249d204a2668a1e155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:10Z,use_quota=True,user_id='98fc46b89fe74941b3ab3897e523c4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a267d7c6-4d2d-4a82-8c08-3d4b2db19381),volume_type_id=a267d7c6-4d2d-4a82-8c08-3d4b2db19381)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Creating volume 3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:50:14 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0916ad3c-a5b8-4721-bd9c-5573bcb1b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71196d27-80c8-4cc5-b987-b54ca3fe2d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:14 devstack sudo[83447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab 1073741824
Apr 06 16:50:14 devstack sudo[83447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:14 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Volume volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba (a4dafefd-dbe4-4932-a704-d0f9bfbd01ba): created successfully
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71196d27-80c8-4cc5-b987-b54ca3fe2d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Flow 'volume_create_manager' (9360386b-06c1-4c54-9c50-7da8f72f9ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-257b1e72-46e9-4b57-94b9-43cd89c9d2ff tempest-ServerRescueNegativeTestJSON-522684252 None] Created volume successfully.
Apr 06 16:50:15 devstack sudo[83447]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab 1073741824" returned: 0 in 1.275s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:16 devstack sudo[83454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:16 devstack sudo[83454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:16 devstack sudo[83454]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 0.954s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:50:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850582de-6479-4c64-a767-bc46db2523ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a56746e-f328-492b-8303-26faa5133eab', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7631a426-c3a3-4d5b-99ef-c0c4b1560b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:17 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Volume volume-3a56746e-f328-492b-8303-26faa5133eab (3a56746e-f328-492b-8303-26faa5133eab): created successfully
Apr 06 16:50:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7631a426-c3a3-4d5b-99ef-c0c4b1560b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Flow 'volume_create_manager' (e7b582ab-f5d2-443f-a5e7-729743191fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8e77dc54-390f-485c-b87c-a5c545801bd2 tempest-GroupsV314Test-208411527 None] Created volume successfully.
Apr 06 16:50:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:19 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Cloning volume 3a56746e-f328-492b-8303-26faa5133eab to volume c04c4031-c9a1-4338-ba37-08970431cbb3
Apr 06 16:50:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Creating offline snapshot 8725c4f3-83ae-4f3c-9f25-f35a0ca54439 of volume 3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:50:19 devstack cinder-volume[82421]: INFO oslo.privsep.daemon [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn3f70qkt/privsep.sock']
Apr 06 16:50:19 devstack sudo[83499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn3f70qkt/privsep.sock
Apr 06 16:50:19 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:20 devstack cinder-volume[82421]: WARNING py.warnings [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 06 16:50:20 devstack cinder-volume[82421]:   .first()
Apr 06 16:50:20 devstack cinder-volume[82421]: 
Apr 06 16:50:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:21 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:21 devstack cinder-volume[82421]: INFO oslo.privsep.daemon [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Spawned new privsep daemon via rootwrap
Apr 06 16:50:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Accepted privsep connection to /tmp/tmpn3f70qkt/privsep.sock {{(pid=82421) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 06 16:50:21 devstack cinder-volume[82421]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 06 16:50:21 devstack cinder-volume[82421]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 06 16:50:21 devstack cinder-volume[82421]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 06 16:50:21 devstack cinder-volume[82421]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83519
Apr 06 16:50:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af67b9de-4b5e-44f8-96bb-19e69c7dba92]: (2,) {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced95ae-2549-4166-8462-e025e71ac9a1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:21 devstack sudo[83540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:21 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:22 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 0.721s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:22 devstack sudo[83548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 1G
Apr 06 16:50:22 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:23 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 1G" returned: 0 in 0.736s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a56746e-f328-492b-8303-26faa5133eab -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:23 devstack sudo[83560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a56746e-f328-492b-8303-26faa5133eab -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439
Apr 06 16:50:23 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:23 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a56746e-f328-492b-8303-26faa5133eab -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439" returned: 0 in 0.588s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:23 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:50:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:23 devstack sudo[83565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439
Apr 06 16:50:23 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:24 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439" returned: 0 in 0.644s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:24 devstack sudo[83569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info
Apr 06 16:50:24 devstack sudo[83569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:24 devstack sudo[83569]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info" returned: 0 in 0.454s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:24 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:50:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:24 devstack sudo[83572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info
Apr 06 16:50:24 devstack sudo[83572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:25 devstack sudo[83572]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.info" returned: 0 in 0.617s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Acquiring lock "cinder-quobyte-c04c4031-c9a1-4338-ba37-08970431cbb3" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-c04c4031-c9a1-4338-ba37-08970431cbb3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] snapshot: 8725c4f3-83ae-4f3c-9f25-f35a0ca54439, volume: c04c4031-c9a1-4338-ba37-08970431cbb3,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d017d4-24ea-4fb3-be6b-c80d57f688f6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:25 devstack sudo[83576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439
Apr 06 16:50:25 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:26 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439" returned: 0 in 0.780s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a56746e-f328-492b-8303-26faa5133eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:50:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:50:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:50:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dec96c-83d3-4546-8c5f-50172f513e2c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:26 devstack sudo[83582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:26 devstack sudo[83582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:27 devstack sudo[83582]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 1.208s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:27 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:50:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:27 devstack sudo[83616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3
Apr 06 16:50:27 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:32 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3" returned: 0 in 4.944s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[61478593-5d56-4c78-ab51-5c3b07d81c22]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:32 devstack sudo[83647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:32 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:33 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 0.780s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:50:33 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Converted 1024.00 MB image at 207.09 MB/s
Apr 06 16:50:33 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:33 devstack sudo[83654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3
Apr 06 16:50:33 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:33 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3" returned: 0 in 0.631s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-c04c4031-c9a1-4338-ba37-08970431cbb3" released by "_copy_volume_from_snapshot" :: held 8.448s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Acquiring lock "cinder-quobyte-8725c4f3-83ae-4f3c-9f25-f35a0ca54439" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-8725c4f3-83ae-4f3c-9f25-f35a0ca54439" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Deleting offline snapshot 8725c4f3-83ae-4f3c-9f25-f35a0ca54439 of volume 3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] snapshot_file for this snap is: volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5447c4c9-43c7-40fa-9d00-f756511b9ce8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:33 devstack sudo[83685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439
Apr 06 16:50:33 devstack sudo[83685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:34 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:50:34 devstack sudo[83685]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439" returned: 0 in 0.658s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a56746e-f328-492b-8303-26faa5133eab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:50:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a7d55-60ac-49c0-a5cf-28c0f70a33e9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:34 devstack sudo[83714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:34 devstack sudo[83714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:35 devstack sudo[83714]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 0.606s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:35 devstack sudo[83720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439
Apr 06 16:50:35 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:35 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439" returned: 0 in 0.498s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:35 devstack sudo[83726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439
Apr 06 16:50:35 devstack sudo[83726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:36 devstack sudo[83726]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab.8725c4f3-83ae-4f3c-9f25-f35a0ca54439" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-8725c4f3-83ae-4f3c-9f25-f35a0ca54439" released by "_delete_snapshot" :: held 2.327s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.548s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.515s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f37aed-3eb5-4126-898c-9a6ada9fe014]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-47c113cd-b1d5-4336-af51-62bc0fa6adc5 tempest-GroupsV314Test-208411527 None] Create group from source-group-8e69cf95-13a6-450c-a12e-676cf1926892 completed successfully.
Apr 06 16:50:36 devstack sudo[83729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272
Apr 06 16:50:36 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Acquiring lock "cinder-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "cinder-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Acquiring lock "cinder-quobyte-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "cinder-quobyte-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba" acquired by "delete_volume" :: waited 0.019s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d1f945-fcc5-43a3-aa67-166eb769eace]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Acquiring lock "cinder-quobyte-c04c4031-c9a1-4338-ba37-08970431cbb3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:36 devstack sudo[83736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba
Apr 06 16:50:36 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-c04c4031-c9a1-4338-ba37-08970431cbb3" acquired by "delete_volume" :: waited 0.023s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6d8fff-869c-477a-9098-d5a78413bda1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:37 devstack sudo[83741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3
Apr 06 16:50:37 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:37 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272" returned: 0 in 0.976s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240', 'name': 'volume-fe68f8c1-6de4-403c-aeac-3ac255963272', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8de017d2-d1e7-4743-89c0-06ac61bc951f', 'enforce_multipath': True} {{(pid=82421) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}}
Apr 06 16:50:37 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-fc09b64a-b382-4737-9768-05c13065dfe0 req-9ea4036d-37ae-49d4-af31-d2ec34b2d238 tempest-DeleteServersTestJSON-1063462737 None] attachment_update completed successfully.
Apr 06 16:50:37 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba" returned: 0 in 0.768s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:37 devstack sudo[83749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba
Apr 06 16:50:37 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:37 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3" returned: 0 in 0.667s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:37 devstack sudo[83751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3
Apr 06 16:50:37 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:38 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "cinder-quobyte-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba" released by "delete_volume" :: held 1.259s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:38 devstack cinder-volume[82421]: WARNING cinder.quota [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:50:38 devstack cinder-volume[82421]: WARNING cinder.quota [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Created reservations ['6b9b48b0-1ad5-4e47-b05e-c5262c89ec32', '49e9eef7-83f6-465a-96e8-a91d04141340', '139580df-a679-41f7-8a69-8889824475cc', '8ea1dde0-c935-45d1-b76c-bcb138f06677'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:38 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c04c4031-c9a1-4338-ba37-08970431cbb3" returned: 0 in 0.796s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-c04c4031-c9a1-4338-ba37-08970431cbb3" released by "delete_volume" :: held 1.510s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:38 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:50:38 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Created reservations ['87e859bc-ad7e-413e-a538-bbcb4eb81aae'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:38 devstack cinder-volume[82421]: WARNING cinder.quota [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-604905397 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-604905397, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:50:38 devstack cinder-volume[82421]: WARNING cinder.quota [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-604905397 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-604905397, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Created reservations ['779a551a-8536-4450-98d5-44bac789d6de', '8b2b1188-8f0e-4f67-b853-2c3ecdf2dd7b', '418d074f-b01b-419f-aad3-6028214d55c4', '127bf672-8f86-4226-a84d-284039ff77da'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:38 devstack sudo[83809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:50:38 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Acquiring lock "cinder-quobyte-3a56746e-f328-492b-8303-26faa5133eab" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-3a56746e-f328-492b-8303-26faa5133eab" acquired by "delete_volume" :: waited 0.064s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:39 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[687fd04f-faac-4d8f-b519-dbe0fd35e5db]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:39 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 1.203s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:39 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:50:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0c18432b-e99c-4f7e-9a1d-2d8385e4ee84 tempest-GroupsV314Test-208411527 None] Delete group completed successfully.
Apr 06 16:50:39 devstack sudo[84153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:39 devstack sudo[84153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:40 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 1.735s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:40 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:50:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Deleted volume successfully.
Apr 06 16:50:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5169dfff-e25a-4d67-8530-13b3975e3882 tempest-ServerRescueNegativeTestJSON-522684252 None] Lock "cinder-a4dafefd-dbe4-4932-a704-d0f9bfbd01ba-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:41 devstack sudo[84153]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 1.279s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:41 devstack sudo[84193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab
Apr 06 16:50:41 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:41 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3a56746e-f328-492b-8303-26faa5133eab" returned: 0 in 0.626s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Lock "cinder-quobyte-3a56746e-f328-492b-8303-26faa5133eab" released by "delete_volume" :: held 1.947s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Created reservations ['e3506f41-2464-4bf8-b0e9-69154c857201'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Created reservations ['838f206d-e0e6-434e-b509-79744f26a04b', '5513727d-e9ec-4f15-9027-937795a0d9e5', '7b931838-6784-4179-aa5b-7dde908238d7', '66afae22-1d3e-4848-9668-05b2283b9c40'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:41 devstack sudo[84205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:50:41 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:42 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.979s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:42 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:50:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-088c7425-5a4a-4e05-a9f3-e28ab71a1a8f tempest-GroupsV314Test-208411527 None] Delete group completed successfully.
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Flow 'volume_create_manager' (f6c56e31-6ba4-4068-87b3-8cc0a6cbe0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f164ac0-c992-4262-92eb-970cea0d0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f164ac0-c992-4262-92eb-970cea0d0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1624059980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da21fe3e-3bdf-40b5-9600-ffb083c1be47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9cdce48006422d91af95d86a0dd864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:46Z,use_quota=True,user_id='6d694c8b207c4c23ae36a4b9025755db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff06fc9-2b02-49ab-8189-649741e3715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff06fc9-2b02-49ab-8189-649741e3715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f7f4b6-f345-46e3-9641-ad750145ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f7f4b6-f345-46e3-9641-ad750145ae14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da21fe3e-3bdf-40b5-9600-ffb083c1be47', 'volume_name': 'volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8899ad-cbc2-4435-b0a3-624884c79bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8899ad-cbc2-4435-b0a3-624884c79bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ab6cb7-a64c-485d-8b11-27299a86e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:46 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Volume da21fe3e-3bdf-40b5-9600-ffb083c1be47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47', 'volume_size': 1}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1624059980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da21fe3e-3bdf-40b5-9600-ffb083c1be47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9cdce48006422d91af95d86a0dd864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:46Z,use_quota=True,user_id='6d694c8b207c4c23ae36a4b9025755db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Creating volume da21fe3e-3bdf-40b5-9600-ffb083c1be47 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:50:46 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:50:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:46 devstack sudo[84279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 1073741824
Apr 06 16:50:46 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:47 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 1073741824" returned: 0 in 0.724s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:47 devstack sudo[84310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47
Apr 06 16:50:47 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:47 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ab6cb7-a64c-485d-8b11-27299a86e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0162959-e388-46e5-b06b-94255bbf7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:47 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Volume volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 (da21fe3e-3bdf-40b5-9600-ffb083c1be47): created successfully
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0162959-e388-46e5-b06b-94255bbf7519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Flow 'volume_create_manager' (f6c56e31-6ba4-4068-87b3-8cc0a6cbe0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-29d008ff-776d-4735-9c6a-9899ce621818 tempest-VolumeQuotasNegativeTestJSON-454840222 None] Created volume successfully.
Apr 06 16:50:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-ae7a3f09-d102-4632-9e2a-0f369c5e2ace req-d9ad36d9-c135-45d2-9af5-afec8be529f9 tempest-DeleteServersTestJSON-1063462737 None] Terminate volume connection completed successfully.
Apr 06 16:50:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-ae7a3f09-d102-4632-9e2a-0f369c5e2ace req-d9ad36d9-c135-45d2-9af5-afec8be529f9 tempest-DeleteServersTestJSON-1063462737 None] Deleting attachment 8de017d2-d1e7-4743-89c0-06ac61bc951f. {{(pid=82421) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Acquiring lock "cinder-da21fe3e-3bdf-40b5-9600-ffb083c1be47-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "cinder-da21fe3e-3bdf-40b5-9600-ffb083c1be47-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Acquiring lock "cinder-quobyte-da21fe3e-3bdf-40b5-9600-ffb083c1be47" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "cinder-quobyte-da21fe3e-3bdf-40b5-9600-ffb083c1be47" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0babe877-7ff1-4f10-a96a-10b7eba62d8e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:49 devstack sudo[84341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47
Apr 06 16:50:49 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:49 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47" returned: 0 in 0.546s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:49 devstack sudo[84349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47
Apr 06 16:50:49 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:50 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-da21fe3e-3bdf-40b5-9600-ffb083c1be47" returned: 0 in 0.504s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "cinder-quobyte-da21fe3e-3bdf-40b5-9600-ffb083c1be47" released by "delete_volume" :: held 1.074s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Created reservations ['a4ac9dfd-106e-45e6-994f-6e6ff1174c26', 'ca254f0f-1681-43d1-81d6-fedde59b8796', 'd9cf265c-fdd3-4629-bf2e-3eb4272087e7', '273b803e-d458-4ddc-b581-9fce1a6dfd27'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:50 devstack sudo[84352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:50:50 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:50 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:50:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Deleted volume successfully.
Apr 06 16:50:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d0deaeee-9131-41d2-af6b-a14e3904b95f tempest-VolumeQuotasNegativeTestJSON-454840222 None] Lock "cinder-da21fe3e-3bdf-40b5-9600-ffb083c1be47-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Acquiring lock "cinder-fe68f8c1-6de4-403c-aeac-3ac255963272-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Lock "cinder-fe68f8c1-6de4-403c-aeac-3ac255963272-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Acquiring lock "cinder-quobyte-fe68f8c1-6de4-403c-aeac-3ac255963272" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Lock "cinder-quobyte-fe68f8c1-6de4-403c-aeac-3ac255963272" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:51 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2570664-107a-4fa6-840b-df3d9bbb70d7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:51 devstack sudo[84355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272
Apr 06 16:50:51 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Flow 'volume_create_manager' (1fe211f3-6696-461c-b4cc-d7511247e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cec45df-705d-4c91-9cc4-b3395e759624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cec45df-705d-4c91-9cc4-b3395e759624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1425485054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30036db7-caaf-42c3-82e1-a2735e77ee7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9495fa96851d4f3dbd6b82912050025f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:52Z,use_quota=True,user_id='f828390be0dd4b91af9e067106ca8705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49930db6-e5bc-4314-bd87-ddef7eef08cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49930db6-e5bc-4314-bd87-ddef7eef08cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e28eeb5-fb03-4bbd-8ae7-e9a6c380cf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e28eeb5-fb03-4bbd-8ae7-e9a6c380cf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30036db7-caaf-42c3-82e1-a2735e77ee7d', 'volume_name': 'volume-30036db7-caaf-42c3-82e1-a2735e77ee7d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b27eb2-1cb7-4654-bc04-d3b7281adb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b27eb2-1cb7-4654-bc04-d3b7281adb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868aeef4-33c2-4771-971e-4ae9069069d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:52 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Volume 30036db7-caaf-42c3-82e1-a2735e77ee7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30036db7-caaf-42c3-82e1-a2735e77ee7d', 'volume_size': 1}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1425485054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30036db7-caaf-42c3-82e1-a2735e77ee7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9495fa96851d4f3dbd6b82912050025f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:52Z,use_quota=True,user_id='f828390be0dd4b91af9e067106ca8705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Creating volume 30036db7-caaf-42c3-82e1-a2735e77ee7d {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:50:52 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:52 devstack sudo[84357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d 1073741824
Apr 06 16:50:52 devstack sudo[84357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:52 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272" returned: 0 in 0.537s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:52 devstack sudo[84362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272
Apr 06 16:50:52 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:52 devstack sudo[84357]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d 1073741824" returned: 0 in 0.556s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:52 devstack sudo[84367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d
Apr 06 16:50:52 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:53 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe68f8c1-6de4-403c-aeac-3ac255963272" returned: 0 in 0.780s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Lock "cinder-quobyte-fe68f8c1-6de4-403c-aeac-3ac255963272" released by "delete_volume" :: held 1.387s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Created reservations ['8aa8b7ae-105d-4944-923b-4fbdbd0cee67', '92111a47-fad8-4be5-a4f3-ef95277fb194', 'b6664175-0d87-412e-bea8-23ec55c27827', '2825d8b5-0b1b-4f8f-a5c9-4af30cc766f1'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:53 devstack sudo[84374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:50:53 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:53 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d" returned: 0 in 0.581s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868aeef4-33c2-4771-971e-4ae9069069d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30036db7-caaf-42c3-82e1-a2735e77ee7d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cb0642-c9fa-47f9-bac4-7e887a653111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:53 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Volume volume-30036db7-caaf-42c3-82e1-a2735e77ee7d (30036db7-caaf-42c3-82e1-a2735e77ee7d): created successfully
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cb0642-c9fa-47f9-bac4-7e887a653111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Flow 'volume_create_manager' (1fe211f3-6696-461c-b4cc-d7511247e86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-bfc0af53-d858-4946-9e54-79bfceb29bc2 tempest-VolumesAdminNegativeTest-1272906550 None] Created volume successfully.
Apr 06 16:50:53 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.493s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:50:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Deleted volume successfully.
Apr 06 16:50:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54f2f6ac-b521-4e62-93ef-424771974ba0 tempest-DeleteServersTestJSON-1063462737 None] Lock "cinder-fe68f8c1-6de4-403c-aeac-3ac255963272-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Acquiring lock "cinder-30036db7-caaf-42c3-82e1-a2735e77ee7d-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "cinder-30036db7-caaf-42c3-82e1-a2735e77ee7d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Acquiring lock "cinder-quobyte-30036db7-caaf-42c3-82e1-a2735e77ee7d" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:50:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "cinder-quobyte-30036db7-caaf-42c3-82e1-a2735e77ee7d" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:50:54 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350bf70-8abb-4532-aa72-a8459e338b13]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:55 devstack sudo[84377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d
Apr 06 16:50:55 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:55 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d" returned: 0 in 0.767s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:50:55 devstack sudo[84383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d
Apr 06 16:50:55 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Flow 'volume_create_manager' (fd4f7b90-9349-40c8-a87b-0894d73d2692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45011e1-f780-4887-9766-5369783368af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45011e1-f780-4887-9766-5369783368af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-670158281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb126fb73284f1fb8b813e581c5f421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:56Z,use_quota=True,user_id='c2e02fe57ced4349a40dac001764ade7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96baae1c-2e60-4603-bb89-6e6a608c2281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96baae1c-2e60-4603-bb89-6e6a608c2281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87181499-f06d-4fbc-96e7-666a1b04f3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87181499-f06d-4fbc-96e7-666a1b04f3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a', 'volume_name': 'volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079f20ff-cf52-4898-aa65-cd9c40041e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079f20ff-cf52-4898-aa65-cd9c40041e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26998f4-378e-406f-9d0f-59ff12dfc679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:55 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Volume 05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a', 'volume_size': 1}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-670158281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb126fb73284f1fb8b813e581c5f421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:50:56Z,use_quota=True,user_id='c2e02fe57ced4349a40dac001764ade7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Creating volume 05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:50:55 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:50:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:55 devstack sudo[84386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a 1073741824
Apr 06 16:50:55 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:56 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-30036db7-caaf-42c3-82e1-a2735e77ee7d" returned: 0 in 0.518s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "cinder-quobyte-30036db7-caaf-42c3-82e1-a2735e77ee7d" released by "delete_volume" :: held 1.329s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Created reservations ['a02a2d04-3070-4de6-a831-d262b20f1b6f', '38750aff-2923-452f-8879-acfb504feb4d', '70d88c23-f7ac-45ba-ac62-1615281eb524', '11f15068-c6a3-4221-ab39-c6c0a6bcecd7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:56 devstack sudo[84390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:50:56 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:56 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a 1073741824" returned: 0 in 0.982s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:56 devstack sudo[84396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a
Apr 06 16:50:56 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:57 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.704s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:50:57 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Deleted volume successfully.
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6346e700-72f9-438d-b588-ff06126b9db2 tempest-VolumesAdminNegativeTest-1272906550 None] Lock "cinder-30036db7-caaf-42c3-82e1-a2735e77ee7d-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:50:57 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" returned: 0 in 0.670s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26998f4-378e-406f-9d0f-59ff12dfc679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9400eca4-0ec7-497e-8752-18f3b7d180a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:50:57 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Volume volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a (05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a): created successfully
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9400eca4-0ec7-497e-8752-18f3b7d180a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:50:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Flow 'volume_create_manager' (fd4f7b90-9349-40c8-a87b-0894d73d2692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:50:57 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-25acf973-b9b5-4ba4-9fa8-8bb73193bfca tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Created volume successfully.
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Creating offline snapshot 50962aed-c2f1-4524-8f8d-71a3c432dc9f of volume 05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e50a10-0b3e-4916-9af5-5b3c339f634f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:58 devstack sudo[84400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a
Apr 06 16:50:58 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:58 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" returned: 0 in 0.725s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:58 devstack sudo[84435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f 1G
Apr 06 16:50:58 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:50:59 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root
Apr 06 16:50:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f 1G" returned: 0 in 0.573s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:50:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:50:59 devstack sudo[84441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f
Apr 06 16:50:59 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:00 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f" returned: 0 in 0.596s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:00 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f is being set with open permissions: ugo+rw
Apr 06 16:51:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:00 devstack sudo[84449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f
Apr 06 16:51:00 devstack sudo[84449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:00 devstack sudo[84449]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f" returned: 0 in 0.513s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:00 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=60,cinder:UPDATE=76,cinder:INSERT=18,cinder:DELETE=7 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:51:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:00 devstack sudo[84452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info
Apr 06 16:51:00 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:01 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info" returned: 0 in 0.514s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:01 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info is being set with open permissions: ugo+rw
Apr 06 16:51:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:01 devstack sudo[84456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info
Apr 06 16:51:01 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:01 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.info" returned: 0 in 0.470s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.529s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-65b9fc59-df71-45b2-907d-81d7f4f9b851 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Create snapshot completed successfully
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "cinder-50962aed-c2f1-4524-8f8d-71a3c432dc9f-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-50962aed-c2f1-4524-8f8d-71a3c432dc9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "cinder-quobyte-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-quobyte-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "cinder-quobyte-50962aed-c2f1-4524-8f8d-71a3c432dc9f" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-quobyte-50962aed-c2f1-4524-8f8d-71a3c432dc9f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Deleting offline snapshot 50962aed-c2f1-4524-8f8d-71a3c432dc9f of volume 05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] snapshot_file for this snap is: volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452b460-e46e-4d03-8ac6-415d3b23c0d4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:02 devstack sudo[84459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f
Apr 06 16:51:02 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:03 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f" returned: 0 in 0.592s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a89724-d76d-4ba5-bb3b-a516c5a98417]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:03 devstack sudo[84465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a
Apr 06 16:51:03 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:03 devstack sudo[84470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:51:03 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:03 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" returned: 0 in 0.539s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:03 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f
Apr 06 16:51:03 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:04 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.642s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:51:04 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f" returned: 0 in 0.562s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:04 devstack sudo[84479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f
Apr 06 16:51:04 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:04 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a.50962aed-c2f1-4524-8f8d-71a3c432dc9f" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-quobyte-50962aed-c2f1-4524-8f8d-71a3c432dc9f" released by "_delete_snapshot" :: held 2.241s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-quobyte-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" released by "delete_snapshot" :: held 2.267s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:04 devstack cinder-volume[82421]: WARNING cinder.quota [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:51:04 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Created reservations ['01797a38-6ff8-4d20-948a-20c38f60ce67', 'ba52bf75-684e-4e88-be20-3f27a18630da', '57333616-9b76-46c0-a1fb-5fbd09c46c34', 'f8cb70b8-b7bf-496e-a684-85dfaf247c82'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:51:04 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Delete snapshot completed successfully.
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9809c931-4613-42ef-835d-c1022643e4e9 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-50962aed-c2f1-4524-8f8d-71a3c432dc9f-delete_snapshot" released by "delete_snapshot" :: held 2.412s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "cinder-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "cinder-quobyte-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-quobyte-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[05928598-ea69-474a-98b3-060fce553937]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:05 devstack sudo[84482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a
Apr 06 16:51:05 devstack sudo[84482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:06 devstack sudo[84482]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" returned: 0 in 0.570s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:06 devstack sudo[84487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a
Apr 06 16:51:06 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:07 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" returned: 0 in 0.536s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-quobyte-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a" released by "delete_volume" :: held 1.146s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Created reservations ['634f29d0-3542-40bf-847e-e4c3b150a08c', 'eb0ca266-782c-4e5a-8e95-5220296d1599', '0246823f-b01c-4b73-9b82-ef1fbf4369e2', 'c3ef557c-f0d2-403b-80e5-70fa51e5f1e8'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:07 devstack sudo[84490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:51:07 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:07 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.534s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:51:07 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Deleted volume successfully.
Apr 06 16:51:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-016ee6f9-7f39-4e79-97e0-cb67c4993920 tempest-VolumeSnapshotQuotasNegativeTestJSON-448047892 None] Lock "cinder-05fbe6b8-8fcc-42a5-8bf4-760bf8d9b73a-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:20 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:UPDATE=76,cinder:SELECT=77,cinder:INSERT=15,cinder:DELETE=2 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:51:20 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:UPDATE=24,cinder:SELECT=10,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Flow 'volume_create_manager' (28e3483d-c06a-458e-b6ed-980e6ef89038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac65a60a-d943-47b0-b69c-c87c3bd5beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac65a60a-d943-47b0-b69c-c87c3bd5beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-629168140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7d432d-2358-4435-8487-c03d46ec006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1eec5371094ccda445003b867640f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:27Z,use_quota=True,user_id='b339dc6b6e0c4a51a83c8e7d4a9367f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8503ea-93ce-4207-8a77-411f0a89f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8503ea-93ce-4207-8a77-411f0a89f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339a292e-125b-4ad7-a2a0-c762ea7e3892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339a292e-125b-4ad7-a2a0-c762ea7e3892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7d432d-2358-4435-8487-c03d46ec006b', 'volume_name': 'volume-ea7d432d-2358-4435-8487-c03d46ec006b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018b8d72-bd49-40c5-ac61-ab7c98897c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018b8d72-bd49-40c5-ac61-ab7c98897c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d2f4e2-9c6a-4d96-acf8-2cded12d2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Volume ea7d432d-2358-4435-8487-c03d46ec006b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7d432d-2358-4435-8487-c03d46ec006b', 'volume_size': 1}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-629168140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7d432d-2358-4435-8487-c03d46ec006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1eec5371094ccda445003b867640f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:27Z,use_quota=True,user_id='b339dc6b6e0c4a51a83c8e7d4a9367f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Creating volume ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:51:26 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:51:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:26 devstack sudo[84623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b 1073741824
Apr 06 16:51:26 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:27 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b 1073741824" returned: 0 in 0.671s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:27 devstack sudo[84652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b
Apr 06 16:51:27 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:28 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b" returned: 0 in 0.599s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d2f4e2-9c6a-4d96-acf8-2cded12d2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7d432d-2358-4435-8487-c03d46ec006b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13864b2-04d5-4cc9-9336-33d88f4c95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:28 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Volume volume-ea7d432d-2358-4435-8487-c03d46ec006b (ea7d432d-2358-4435-8487-c03d46ec006b): created successfully
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13864b2-04d5-4cc9-9336-33d88f4c95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Flow 'volume_create_manager' (28e3483d-c06a-458e-b6ed-980e6ef89038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:28 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-684a3f6b-66ee-4d39-aff8-a5413919f276 req-d98ee6f8-c907-4af3-afac-ab2ef5b6a40a tempest-VolumesSnapshotsTestJSON-1913687964 None] Created volume successfully.
Apr 06 16:51:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Creating offline snapshot 9e02f134-3ad6-4aa6-ae75-e8fea3ae380f of volume ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:51:29 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c9b7d9-bd8a-4f99-9a49-0a3162db9969]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:29 devstack sudo[84658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b
Apr 06 16:51:29 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:30 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b" returned: 0 in 0.823s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:30 devstack sudo[84664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f 1G
Apr 06 16:51:30 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:31 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f 1G" returned: 0 in 1.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7d432d-2358-4435-8487-c03d46ec006b -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:31 devstack sudo[84677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7d432d-2358-4435-8487-c03d46ec006b -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f
Apr 06 16:51:31 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:32 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea7d432d-2358-4435-8487-c03d46ec006b -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" returned: 0 in 1.037s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:32 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f is being set with open permissions: ugo+rw
Apr 06 16:51:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:32 devstack sudo[84685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f
Apr 06 16:51:32 devstack sudo[84685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:34 devstack sudo[84685]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" returned: 0 in 1.266s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:34 devstack sudo[84689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info
Apr 06 16:51:34 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:34 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info" returned: 0 in 0.538s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:34 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info is being set with open permissions: ugo+rw
Apr 06 16:51:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:34 devstack sudo[84694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info
Apr 06 16:51:34 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:35 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.info" returned: 0 in 0.677s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.921s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:35 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-55e8a87b-0b4e-4c79-a602-7a49aa8c629a req-12d9c9bc-4a9d-4fe8-a6e5-10f7361d7bc1 tempest-VolumesSnapshotsTestJSON-1913687964 None] Create snapshot completed successfully
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "cinder-9e02f134-3ad6-4aa6-ae75-e8fea3ae380f-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-9e02f134-3ad6-4aa6-ae75-e8fea3ae380f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "cinder-quobyte-ea7d432d-2358-4435-8487-c03d46ec006b" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-quobyte-ea7d432d-2358-4435-8487-c03d46ec006b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "cinder-quobyte-9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-quobyte-9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Deleting offline snapshot 9e02f134-3ad6-4aa6-ae75-e8fea3ae380f of volume ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] snapshot_file for this snap is: volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[71823f60-aa88-45f9-90c2-77115d1a486f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:36 devstack sudo[84704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f
Apr 06 16:51:36 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:37 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" returned: 0 in 0.921s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea7d432d-2358-4435-8487-c03d46ec006b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:51:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1985e-c606-44a4-a298-8361b55d9de9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:37 devstack sudo[84709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b
Apr 06 16:51:37 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:38 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b" returned: 0 in 0.784s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:38 devstack sudo[84724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f
Apr 06 16:51:38 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:39 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" returned: 0 in 0.835s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:39 devstack sudo[84769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f
Apr 06 16:51:39 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:39 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b.9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-quobyte-9e02f134-3ad6-4aa6-ae75-e8fea3ae380f" released by "_delete_snapshot" :: held 3.098s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-quobyte-ea7d432d-2358-4435-8487-c03d46ec006b" released by "delete_snapshot" :: held 3.132s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG cinder.quota [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Created reservations ['65d6cfae-417f-482a-a4bb-55efd9a83639', '1b347c2a-c2b2-437a-894e-772a37e8784c', '12790d1c-5c55-446c-a1ab-618597802a0e', 'bb524b6b-b438-49e7-b09d-c83e980e08d1'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:51:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Delete snapshot completed successfully.
Apr 06 16:51:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-132d37ee-9263-4432-a809-4423ae686f00 req-fb2792d5-615b-43f6-91d6-28ccd4b34e6b tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-9e02f134-3ad6-4aa6-ae75-e8fea3ae380f-delete_snapshot" released by "delete_snapshot" :: held 3.428s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "cinder-ea7d432d-2358-4435-8487-c03d46ec006b-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-ea7d432d-2358-4435-8487-c03d46ec006b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "cinder-quobyte-ea7d432d-2358-4435-8487-c03d46ec006b" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-quobyte-ea7d432d-2358-4435-8487-c03d46ec006b" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923f34b-7b3f-4755-b5e0-13f404c9e33e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:41 devstack sudo[84772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b
Apr 06 16:51:41 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:42 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b" returned: 0 in 0.959s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:42 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b
Apr 06 16:51:42 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:42 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ea7d432d-2358-4435-8487-c03d46ec006b" returned: 0 in 0.648s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-quobyte-ea7d432d-2358-4435-8487-c03d46ec006b" released by "delete_volume" :: held 1.692s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG cinder.quota [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Created reservations ['ecc5b822-1be1-4fd5-8c82-d0ae055bda81', 'ad588773-665c-4bbf-a472-1973271856e7', 'fcde0ec6-9141-4e31-8bde-1947a3239d91', 'f5e9b031-2fff-468f-935a-03e9f6294998'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:42 devstack sudo[84801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:51:42 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:44 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 1.259s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:44 devstack cinder-volume[82421]: DEBUG cinder.manager [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:51:44 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Deleted volume successfully.
Apr 06 16:51:44 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-de0ef15d-9174-47cb-b5b6-b31ff1360d98 req-d3f99f60-e961-4518-8f10-4057fb86aaa7 tempest-VolumesSnapshotsTestJSON-1913687964 None] Lock "cinder-ea7d432d-2358-4435-8487-c03d46ec006b-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Flow 'volume_create_manager' (59fffc54-5e61-4985-a032-c5ea1964180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c2c067-63b0-4251-b743-4b1fc40974a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c2c067-63b0-4251-b743-4b1fc40974a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:50Z,deleted=False,deleted_at=None,display_description='',display_name='bc707e63-84c4-4bb7-98ba-9e3ddecd3f24-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bcd35b-8895-4ba6-8ec9-912aae447025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a08bb19c0f4f04936c6f155914aba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:51Z,use_quota=True,user_id='c38c7aec45044a8896e8a23fa0cb1e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381f150b-2c0b-4be7-adde-c8ff22ef68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (381f150b-2c0b-4be7-adde-c8ff22ef68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f89f71-c85b-4dff-a7f1-acd14bd78005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f89f71-c85b-4dff-a7f1-acd14bd78005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bcd35b-8895-4ba6-8ec9-912aae447025', 'volume_name': 'volume-f4bcd35b-8895-4ba6-8ec9-912aae447025', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5380cc7e-5833-4d82-a81b-a511b2fe08ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5380cc7e-5833-4d82-a81b-a511b2fe08ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2a28aa-bcf4-4167-92c9-1bbd0a32ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:50 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Volume f4bcd35b-8895-4ba6-8ec9-912aae447025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bcd35b-8895-4ba6-8ec9-912aae447025', 'volume_size': 1}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:50Z,deleted=False,deleted_at=None,display_description='',display_name='bc707e63-84c4-4bb7-98ba-9e3ddecd3f24-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bcd35b-8895-4ba6-8ec9-912aae447025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a08bb19c0f4f04936c6f155914aba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:51Z,use_quota=True,user_id='c38c7aec45044a8896e8a23fa0cb1e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Creating volume f4bcd35b-8895-4ba6-8ec9-912aae447025 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:51:50 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:51:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:50 devstack sudo[84899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 1073741824
Apr 06 16:51:50 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:52 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 1073741824" returned: 0 in 1.299s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:52 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025
Apr 06 16:51:52 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:52 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025" returned: 0 in 0.622s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2a28aa-bcf4-4167-92c9-1bbd0a32ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bcd35b-8895-4ba6-8ec9-912aae447025', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13781445-d1e4-4a3d-be81-fcab794af9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:52 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Volume volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 (f4bcd35b-8895-4ba6-8ec9-912aae447025): created successfully
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13781445-d1e4-4a3d-be81-fcab794af9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:52 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Flow 'volume_create_manager' (59fffc54-5e61-4985-a032-c5ea1964180a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:52 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-cdd71692-ecdf-4186-b2d4-21bed139cc07 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Created volume successfully.
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (982cf81e-4c1e-43f3-94d9-77e76161248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac21a9e-2d39-40ae-849a-3583bcaacdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac21a9e-2d39-40ae-849a-3583bcaacdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061929779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:54Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f6a440-9c5f-4612-9d3c-abdc6355fc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f6a440-9c5f-4612-9d3c-abdc6355fc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08deb7c7-1fdb-4a1a-a34a-fd73c6ae3fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08deb7c7-1fdb-4a1a-a34a-fd73c6ae3fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f', 'volume_name': 'volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925a3f47-f7d8-4a8f-949f-0e180059b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925a3f47-f7d8-4a8f-949f-0e180059b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbcc67b-89ce-4c72-802c-0baa535f44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:53 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Volume a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f', 'volume_size': 1}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061929779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:54Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Creating volume a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:51:53 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:51:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:53 devstack sudo[84920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f 1073741824
Apr 06 16:51:53 devstack sudo[84920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:55 devstack sudo[84920]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f 1073741824" returned: 0 in 1.559s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:55 devstack sudo[84935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f
Apr 06 16:51:55 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:55 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.333s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbcc67b-89ce-4c72-802c-0baa535f44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8cc841-e003-49aa-b3c0-23f07bb5fe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2761b5ed-dc90-4c0e-9286-50c2d4c2cd60]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:56 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Volume volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f (a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f): created successfully
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8cc841-e003-49aa-b3c0-23f07bb5fe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (982cf81e-4c1e-43f3-94d9-77e76161248b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:56 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5759b185-8549-46a7-b977-7ebddf7935d5 tempest-VolumesActionsTest-2043751323 None] Created volume successfully.
Apr 06 16:51:56 devstack sudo[84943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025
Apr 06 16:51:56 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b42e3202-2e05-4352-acf5-1e87f150291c tempest-VolumesActionsTest-2043751323 None] Acquiring lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" by "attach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b42e3202-2e05-4352-acf5-1e87f150291c tempest-VolumesActionsTest-2043751323 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" acquired by "attach_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:56 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b42e3202-2e05-4352-acf5-1e87f150291c tempest-VolumesActionsTest-2043751323 None] Attaching volume a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f to instance 2597861e-6841-491d-b034-1ce5646e8999 at mountpoint /dev/vdb on host None.
Apr 06 16:51:56 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b42e3202-2e05-4352-acf5-1e87f150291c tempest-VolumesActionsTest-2043751323 None] Attach volume completed successfully.
Apr 06 16:51:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b42e3202-2e05-4352-acf5-1e87f150291c tempest-VolumesActionsTest-2043751323 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" released by "attach_volume" :: held 0.085s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:57 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025" returned: 0 in 1.011s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.033s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240', 'name': 'volume-f4bcd35b-8895-4ba6-8ec9-912aae447025', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49aac38b-e0a2-4adc-a138-56c68413a660', 'enforce_multipath': True} {{(pid=82421) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}}
Apr 06 16:51:57 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-e8576298-825d-4f43-9455-9894fab6061a req-bce3a419-2819-45c4-b04e-593f121e4d1b tempest-ServerBootFromVolumeStableRescueTest-304154173 None] attachment_update completed successfully.
Apr 06 16:51:57 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:51:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Flow 'volume_create_manager' (990a512f-26f8-40da-bd28-32c99fae75ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:51:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a744d088-3fca-45f1-bee5-cd44efe95a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a744d088-3fca-45f1-bee5-cd44efe95a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-734574018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41a670f1ef4def939fe29b8ac95913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:58Z,use_quota=True,user_id='fc31d1e569224f55aea0165e402474eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7b2668-7776-4e5c-ae20-7363458ec1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7b2668-7776-4e5c-ae20-7363458ec1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cccb85-5c51-4fc0-a829-ad965ecd201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cccb85-5c51-4fc0-a829-ad965ecd201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f', 'volume_name': 'volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22e2217-15d5-4134-90ca-851845437f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22e2217-15d5-4134-90ca-851845437f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f53566-d3a6-47f1-89de-cd4464ac52ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:51:58 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Volume fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f', 'volume_size': 1}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-734574018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41a670f1ef4def939fe29b8ac95913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:51:58Z,use_quota=True,user_id='fc31d1e569224f55aea0165e402474eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Creating volume fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:51:58 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:51:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:58 devstack sudo[84948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f 1073741824
Apr 06 16:51:58 devstack sudo[84948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:51:58 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2e96714f-b88a-4daa-a15d-b7541ef6615e tempest-VolumesActionsTest-893773844 None] Terminate volume connection completed successfully.
Apr 06 16:51:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2e96714f-b88a-4daa-a15d-b7541ef6615e tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-detach_volume" by "detach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:51:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2e96714f-b88a-4daa-a15d-b7541ef6615e tempest-VolumesActionsTest-893773844 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:51:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2e96714f-b88a-4daa-a15d-b7541ef6615e tempest-VolumesActionsTest-893773844 None] Detaching volume a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f from instance 2597861e-6841-491d-b034-1ce5646e8999.
Apr 06 16:51:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2e96714f-b88a-4daa-a15d-b7541ef6615e tempest-VolumesActionsTest-893773844 None] Detach volume completed successfully.
Apr 06 16:51:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2e96714f-b88a-4daa-a15d-b7541ef6615e tempest-VolumesActionsTest-893773844 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:51:59 devstack sudo[84948]: pam_unix(sudo:session): session closed for user root
Apr 06 16:51:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f 1073741824" returned: 0 in 1.308s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:51:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:51:59 devstack sudo[84954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f
Apr 06 16:51:59 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ecc786bc-d032-487c-9283-0430061deae3 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-detach_volume" by "detach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ecc786bc-d032-487c-9283-0430061deae3 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ecc786bc-d032-487c-9283-0430061deae3 tempest-VolumesActionsTest-2043751323 None] Volume detach called, but volume not attached.
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ecc786bc-d032-487c-9283-0430061deae3 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:00 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f" returned: 0 in 0.751s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f53566-d3a6-47f1-89de-cd4464ac52ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35823f6f-4626-41ac-b15b-852f81bbd1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:00 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Volume volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f (fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f): created successfully
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35823f6f-4626-41ac-b15b-852f81bbd1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Flow 'volume_create_manager' (990a512f-26f8-40da-bd28-32c99fae75ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a9694e2c-b1dc-4ef5-95cf-9e3ec010a5b1 tempest-ServersNegativeTestJSON-589123426 None] Created volume successfully.
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "cinder-quobyte-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-quobyte-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" acquired by "delete_volume" :: waited 0.040s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:01 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f07f11-97b0-4127-b2fc-8821994d093c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:01 devstack sudo[85044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f
Apr 06 16:52:01 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:02 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" returned: 0 in 1.025s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:02 devstack sudo[85049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f
Apr 06 16:52:02 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:03 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" returned: 0 in 1.220s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-quobyte-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f" released by "delete_volume" :: held 2.348s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Created reservations ['e4fabcaa-3ca1-4529-94cc-4f58ab92c9ce', 'e94255ae-c3bd-4f6f-8af9-95365001e951', 'b6f05175-18d8-496a-95e7-381ddf0e1b03', '095a839e-21a5-43ef-a42e-c5fb20af0fca'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:03 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:03 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Flow 'volume_create_manager' (fab8be5e-45de-4796-b138-5b6d07b094c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:03 devstack sudo[85392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fb548e-a390-4dc4-b123-919fe3774b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:03 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fb548e-a390-4dc4-b123-919fe3774b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2100479621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8dff5b-8b7d-43f0-af18-3d63230d6527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41a670f1ef4def939fe29b8ac95913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:04Z,use_quota=True,user_id='fc31d1e569224f55aea0165e402474eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6ceece-fbc7-4950-853f-3909ea7f7176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6ceece-fbc7-4950-853f-3909ea7f7176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7a8ea3-753e-4677-8358-f0ad8a86b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7a8ea3-753e-4677-8358-f0ad8a86b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc8dff5b-8b7d-43f0-af18-3d63230d6527', 'volume_name': 'volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952bd25-91ca-4040-8078-ccbfb48abbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b952bd25-91ca-4040-8078-ccbfb48abbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4739edca-6179-45a0-b6c5-44e192c49c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:03 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Volume bc8dff5b-8b7d-43f0-af18-3d63230d6527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527', 'volume_size': 1}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2100479621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc8dff5b-8b7d-43f0-af18-3d63230d6527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e41a670f1ef4def939fe29b8ac95913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:04Z,use_quota=True,user_id='fc31d1e569224f55aea0165e402474eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Creating volume bc8dff5b-8b7d-43f0-af18-3d63230d6527 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:03 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:03 devstack sudo[85395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 1073741824
Apr 06 16:52:03 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:05 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 1.666s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:05 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:05 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Deleted volume successfully.
Apr 06 16:52:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8e01583a-be1c-4089-9241-5bd6021638f8 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-a85005bd-789d-4e8c-bbf0-8c3c7b23aa7f-delete_volume" released by "delete_volume" :: held 4.448s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:05 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 1.721s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:05 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:06 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 1073741824" returned: 0 in 2.220s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:06 devstack sudo[85429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527
Apr 06 16:52:06 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:07 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527" returned: 0 in 1.225s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] <== create_volume: return (3529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.532s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4739edca-6179-45a0-b6c5-44e192c49c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620ce5f8-018f-4fab-ac63-ff781eaecbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:07 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Volume volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 (bc8dff5b-8b7d-43f0-af18-3d63230d6527): created successfully
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620ce5f8-018f-4fab-ac63-ff781eaecbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Flow 'volume_create_manager' (fab8be5e-45de-4796-b138-5b6d07b094c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:07 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b72696a0-2d6a-4f39-aa38-0f47afad2960 tempest-ServersNegativeTestJSON-589123426 None] Created volume successfully.
Apr 06 16:52:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "cinder-bc8dff5b-8b7d-43f0-af18-3d63230d6527-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-bc8dff5b-8b7d-43f0-af18-3d63230d6527-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "cinder-quobyte-bc8dff5b-8b7d-43f0-af18-3d63230d6527" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-quobyte-bc8dff5b-8b7d-43f0-af18-3d63230d6527" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:08 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4a6c0-ee30-416b-b5d7-7c56e45f0c24]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:08 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527
Apr 06 16:52:08 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:09 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527" returned: 0 in 0.559s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:09 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527
Apr 06 16:52:09 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:09 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bc8dff5b-8b7d-43f0-af18-3d63230d6527" returned: 0 in 0.636s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-quobyte-bc8dff5b-8b7d-43f0-af18-3d63230d6527" released by "delete_volume" :: held 1.241s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Created reservations ['277dd9f0-9d2b-4568-8a09-43d7e1680b97', 'aa7b7d4f-e62c-44fb-bf33-089ca32a07f7', '2ad5f9d2-c24b-4f08-9694-e0220a9439cd', 'f806d9f4-ba82-41dc-88a9-fe0f4566ffad'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:10 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:10 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:10 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.445s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Deleted volume successfully.
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a914608-230e-47e8-af64-b91bb26a939e tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-bc8dff5b-8b7d-43f0-af18-3d63230d6527-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "cinder-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "cinder-quobyte-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-quobyte-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:11 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63040dd-e0e9-4214-a19b-d7ac5d34ebd6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:11 devstack sudo[85451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f
Apr 06 16:52:11 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:11 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f" returned: 0 in 0.778s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:11 devstack sudo[85477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f
Apr 06 16:52:11 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (90fd9b89-84f5-474c-98d7-0f14b3e4753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76fbb1a-06d4-407d-8ef5-aa854ee68fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76fbb1a-06d4-407d-8ef5-aa854ee68fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-842175046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8194f4b2-7267-462d-92cf-6c35635f9588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:12Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5784d56-4cd4-4486-8a21-d7d8a818d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5784d56-4cd4-4486-8a21-d7d8a818d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f89330-5614-4b4f-a631-9d4888275fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f89330-5614-4b4f-a631-9d4888275fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8194f4b2-7267-462d-92cf-6c35635f9588', 'volume_name': 'volume-8194f4b2-7267-462d-92cf-6c35635f9588', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8079e41d-0c81-4d5f-ab69-da5b793cb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8079e41d-0c81-4d5f-ab69-da5b793cb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc0f848-53fc-4404-8626-fa92d2579fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:12 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Volume 8194f4b2-7267-462d-92cf-6c35635f9588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8194f4b2-7267-462d-92cf-6c35635f9588', 'volume_size': 1}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-842175046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8194f4b2-7267-462d-92cf-6c35635f9588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:12Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Creating volume 8194f4b2-7267-462d-92cf-6c35635f9588 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:12 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:12 devstack sudo[85481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588 1073741824
Apr 06 16:52:12 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:12 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f" returned: 0 in 0.705s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-quobyte-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f" released by "delete_volume" :: held 1.534s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Created reservations ['afa01426-2bb1-44de-b75e-62f8b41d2591', '074afde3-bb7c-46f4-9b31-dead92111ba3', '8fe9c14f-e4ee-4e35-ae54-b71352433e5c', '2198749c-6d84-4c52-b301-6eab3cc51173'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:12 devstack sudo[85490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:12 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:12 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588 1073741824" returned: 0 in 0.603s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:12 devstack sudo[85496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588
Apr 06 16:52:12 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:13 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.746s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Deleted volume successfully.
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2628ed4d-41c7-4b8c-8205-0e164edf3c4a tempest-ServersNegativeTestJSON-589123426 None] Lock "cinder-fcf389e4-ae01-4f2a-9e0d-a5cbdf85f83f-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:13 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588" returned: 0 in 0.813s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc0f848-53fc-4404-8626-fa92d2579fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8194f4b2-7267-462d-92cf-6c35635f9588', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1d4b45-cc30-4c5c-8f34-b5baf3e5180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Volume volume-8194f4b2-7267-462d-92cf-6c35635f9588 (8194f4b2-7267-462d-92cf-6c35635f9588): created successfully
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1d4b45-cc30-4c5c-8f34-b5baf3e5180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (90fd9b89-84f5-474c-98d7-0f14b3e4753c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b6016564-9e5d-4cf5-8df2-695f178e4439 tempest-VolumesActionsTest-2043751323 None] Created volume successfully.
Apr 06 16:52:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-8194f4b2-7267-462d-92cf-6c35635f9588-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Lock "cinder-8194f4b2-7267-462d-92cf-6c35635f9588-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-quobyte-8194f4b2-7267-462d-92cf-6c35635f9588" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-8194f4b2-7267-462d-92cf-6c35635f9588" acquired by "delete_volume" :: waited 0.030s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538f2ea-9527-429a-92a5-5242692ae044]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:14 devstack sudo[85527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588
Apr 06 16:52:14 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:15 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588" returned: 0 in 0.680s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:15 devstack sudo[85557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588
Apr 06 16:52:15 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:15 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-8194f4b2-7267-462d-92cf-6c35635f9588" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-8194f4b2-7267-462d-92cf-6c35635f9588" released by "delete_volume" :: held 1.164s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Created reservations ['70492c1c-2ba6-491b-9b39-3842452a0ec4', 'ce9c5946-484e-4923-b1a8-eea7fb4d25cb', 'c27a9215-d05f-4396-9987-453163aedd9c', '0a03c940-5335-4895-a05e-3518837d1994'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:15 devstack sudo[85564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:15 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:16 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:16 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Deleted volume successfully.
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a387dbd0-45ab-43e9-b793-8175fc8dda95 tempest-VolumesActionsTest-893773844 None] Lock "cinder-8194f4b2-7267-462d-92cf-6c35635f9588-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (2cc907b4-e526-4baa-9f04-aa13bc08a907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba593dc-f998-4d27-910d-7584add6d44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba593dc-f998-4d27-910d-7584add6d44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976972275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890eefc0-04b5-480c-bf84-2ea039a65471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:17Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9793b8-0e44-42b3-818e-648c6704951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9793b8-0e44-42b3-818e-648c6704951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea778274-73ed-4a9d-8ecd-b21b46dcd282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea778274-73ed-4a9d-8ecd-b21b46dcd282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890eefc0-04b5-480c-bf84-2ea039a65471', 'volume_name': 'volume-890eefc0-04b5-480c-bf84-2ea039a65471', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da17090-b289-47a0-9c8f-4ade91d212a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da17090-b289-47a0-9c8f-4ade91d212a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41602e54-c4dd-49bb-bf74-7a4a0c8b8545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:16 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Volume 890eefc0-04b5-480c-bf84-2ea039a65471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890eefc0-04b5-480c-bf84-2ea039a65471', 'volume_size': 1}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976972275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890eefc0-04b5-480c-bf84-2ea039a65471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:17Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Creating volume 890eefc0-04b5-480c-bf84-2ea039a65471 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:16 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:16 devstack sudo[85572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471 1073741824
Apr 06 16:52:17 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Flow 'volume_create_manager' (3e86888e-c806-47cd-a93b-875017a9ad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f70696-732a-41b3-8d20-ed5a76df13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f70696-732a-41b3-8d20-ed5a76df13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466646853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f87e06-ad82-472b-b393-cd35973f6ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef113b24009e408490d53100260e97ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:17Z,use_quota=True,user_id='6886d210ecbb49fcb7320ab08a1a6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a92f5-08a3-487d-a308-d5a5363f2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a92f5-08a3-487d-a308-d5a5363f2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d12c4f1-ca85-4091-976d-2224833a4f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d12c4f1-ca85-4091-976d-2224833a4f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f87e06-ad82-472b-b393-cd35973f6ad6', 'volume_name': 'volume-f2f87e06-ad82-472b-b393-cd35973f6ad6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033a28b4-cc6a-47f1-bdbe-a514a5f3bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033a28b4-cc6a-47f1-bdbe-a514a5f3bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2570a038-22ec-41e0-aa75-55ac9c6ae317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:17 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Volume f2f87e06-ad82-472b-b393-cd35973f6ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f87e06-ad82-472b-b393-cd35973f6ad6', 'volume_size': 1}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:17 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471 1073741824" returned: 0 in 0.488s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:17 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471
Apr 06 16:52:17 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:17 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-466646853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f87e06-ad82-472b-b393-cd35973f6ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef113b24009e408490d53100260e97ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:17Z,use_quota=True,user_id='6886d210ecbb49fcb7320ab08a1a6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Creating volume f2f87e06-ad82-472b-b393-cd35973f6ad6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:17 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41602e54-c4dd-49bb-bf74-7a4a0c8b8545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890eefc0-04b5-480c-bf84-2ea039a65471', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:17 devstack sudo[85580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 1073741824
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d9d458-9643-41b6-995d-51762b91d8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:17 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:17 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Volume volume-890eefc0-04b5-480c-bf84-2ea039a65471 (890eefc0-04b5-480c-bf84-2ea039a65471): created successfully
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d9d458-9643-41b6-995d-51762b91d8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (2cc907b4-e526-4baa-9f04-aa13bc08a907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9c293683-79df-4854-a133-f8595cb4c2f1 tempest-VolumesActionsTest-2043751323 None] Created volume successfully.
Apr 06 16:52:18 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 1073741824" returned: 0 in 0.710s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:18 devstack sudo[85645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6
Apr 06 16:52:18 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-890eefc0-04b5-480c-bf84-2ea039a65471-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Lock "cinder-890eefc0-04b5-480c-bf84-2ea039a65471-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:19 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6" returned: 0 in 0.547s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-quobyte-890eefc0-04b5-480c-bf84-2ea039a65471" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2570a038-22ec-41e0-aa75-55ac9c6ae317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f87e06-ad82-472b-b393-cd35973f6ad6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb596bc-76ea-451c-97c7-e3d7aa924f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:19 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Volume volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 (f2f87e06-ad82-472b-b393-cd35973f6ad6): created successfully
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb596bc-76ea-451c-97c7-e3d7aa924f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Flow 'volume_create_manager' (3e86888e-c806-47cd-a93b-875017a9ad82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-890eefc0-04b5-480c-bf84-2ea039a65471" acquired by "delete_volume" :: waited 0.032s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:19 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-77a96859-b902-4e4e-9a4f-fed4b7ed155a tempest-VolumesListAdminTestJSON-1197273611 None] Created volume successfully.
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c74e630-6845-40f2-b761-af7d9b5fe7a2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:19 devstack sudo[85649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471
Apr 06 16:52:19 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:19 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471" returned: 0 in 0.493s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:19 devstack sudo[85678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471
Apr 06 16:52:19 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:20 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-890eefc0-04b5-480c-bf84-2ea039a65471" returned: 0 in 0.736s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-890eefc0-04b5-480c-bf84-2ea039a65471" released by "delete_volume" :: held 1.267s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Created reservations ['2a36cf49-1ab5-4e13-ae99-9ef01cff9b0f', 'd393e5b4-b83d-4a41-bbe0-2551ce2c7aa9', '5083f0e7-9cf3-4dd5-a48b-a269616090ea', '3d3843e4-7471-4956-ae4c-602bb2ada08b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=63,cinder:UPDATE=70,cinder:INSERT=24,cinder:DELETE=7 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:UPDATE=85,cinder:SELECT=70,cinder:INSERT=15,cinder:DELETE=7 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:20 devstack sudo[85683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:20 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Flow 'volume_create_manager' (942d6f1c-f917-4a94-952f-c683dc2a3c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a68c34-35d9-409c-9e60-4ad311bb6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a68c34-35d9-409c-9e60-4ad311bb6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2138851173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73cc144-58ce-4f69-9fec-ce4bfc6e2734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef113b24009e408490d53100260e97ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:21Z,use_quota=True,user_id='6886d210ecbb49fcb7320ab08a1a6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b150805-36ff-4751-97c1-bce3557181a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b150805-36ff-4751-97c1-bce3557181a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf937c22-d262-45fd-9239-03a38f6ec770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf937c22-d262-45fd-9239-03a38f6ec770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73cc144-58ce-4f69-9fec-ce4bfc6e2734', 'volume_name': 'volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de356617-ec9e-43f8-8277-fb7c7b13c858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de356617-ec9e-43f8-8277-fb7c7b13c858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7980deb2-28cb-49d3-9f57-6f92cb0f76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:20 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Volume b73cc144-58ce-4f69-9fec-ce4bfc6e2734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734', 'volume_size': 1}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2138851173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73cc144-58ce-4f69-9fec-ce4bfc6e2734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef113b24009e408490d53100260e97ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:21Z,use_quota=True,user_id='6886d210ecbb49fcb7320ab08a1a6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Creating volume b73cc144-58ce-4f69-9fec-ce4bfc6e2734 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:20 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:20 devstack sudo[85685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 1073741824
Apr 06 16:52:20 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:21 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.583s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Deleted volume successfully.
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94c7bdc8-3a3a-47e3-88b9-5c3a01a0689f tempest-VolumesActionsTest-893773844 None] Lock "cinder-890eefc0-04b5-480c-bf84-2ea039a65471-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:21 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 1073741824" returned: 0 in 0.874s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (f2f484df-9957-4e3b-aec1-8d2b7bc0c7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb1e83a-a4e6-4fda-aab8-9f5aeeee0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb1e83a-a4e6-4fda-aab8-9f5aeeee0db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367998686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786947d0-4531-4734-8892-6ff234c6f912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:22Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6796cc4-da43-4c41-a330-9481907245a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6796cc4-da43-4c41-a330-9481907245a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf14d89-f673-40d7-b076-11880718bc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf14d89-f673-40d7-b076-11880718bc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786947d0-4531-4734-8892-6ff234c6f912', 'volume_name': 'volume-786947d0-4531-4734-8892-6ff234c6f912', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b0904-ad1d-460e-b2e8-074f684e2f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b0904-ad1d-460e-b2e8-074f684e2f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e024c2e0-9ef1-46e2-9988-715e78dab5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:21 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Volume 786947d0-4531-4734-8892-6ff234c6f912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786947d0-4531-4734-8892-6ff234c6f912', 'volume_size': 1}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:22 devstack sudo[85705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734
Apr 06 16:52:22 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:22 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367998686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786947d0-4531-4734-8892-6ff234c6f912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:22Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Creating volume 786947d0-4531-4734-8892-6ff234c6f912 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:22 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7980deb2-28cb-49d3-9f57-6f92cb0f76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225772d5-ade4-47ac-9383-39769c41912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:22 devstack sudo[85708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912 1073741824
Apr 06 16:52:22 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:22 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Volume volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 (b73cc144-58ce-4f69-9fec-ce4bfc6e2734): created successfully
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225772d5-ade4-47ac-9383-39769c41912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Flow 'volume_create_manager' (942d6f1c-f917-4a94-952f-c683dc2a3c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-56c636ac-1aa9-45f9-84ce-237180336c1f tempest-VolumesListAdminTestJSON-1197273611 None] Created volume successfully.
Apr 06 16:52:23 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912 1073741824" returned: 0 in 0.832s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:23 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912
Apr 06 16:52:23 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Flow 'volume_create_manager' (8808d72c-ffb3-4ff5-9f6a-aa86a44bb612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490ba043-876a-45d3-995a-aa0dc7d00d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490ba043-876a-45d3-995a-aa0dc7d00d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-602021945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9004e314-d7bc-458d-9f31-8a883ad2e133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef113b24009e408490d53100260e97ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:23Z,use_quota=True,user_id='6886d210ecbb49fcb7320ab08a1a6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34799327-2121-4add-97e2-7fc634c1096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34799327-2121-4add-97e2-7fc634c1096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4be865-d2c5-4596-a48b-498d6b45d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4be865-d2c5-4596-a48b-498d6b45d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9004e314-d7bc-458d-9f31-8a883ad2e133', 'volume_name': 'volume-9004e314-d7bc-458d-9f31-8a883ad2e133', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a0041-d573-42a0-85b9-8850b7b0e81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a0041-d573-42a0-85b9-8850b7b0e81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de091ef4-ae70-4fce-b459-fb5b7c7f2c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Volume 9004e314-d7bc-458d-9f31-8a883ad2e133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9004e314-d7bc-458d-9f31-8a883ad2e133', 'volume_size': 1}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:23 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912" returned: 0 in 0.572s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.272s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-602021945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9004e314-d7bc-458d-9f31-8a883ad2e133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef113b24009e408490d53100260e97ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:23Z,use_quota=True,user_id='6886d210ecbb49fcb7320ab08a1a6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Creating volume 9004e314-d7bc-458d-9f31-8a883ad2e133 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:23 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e024c2e0-9ef1-46e2-9988-715e78dab5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786947d0-4531-4734-8892-6ff234c6f912', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:23 devstack sudo[85744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133 1073741824
Apr 06 16:52:23 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbff2ce9-8805-4e21-8f6f-e520f65ef02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Volume volume-786947d0-4531-4734-8892-6ff234c6f912 (786947d0-4531-4734-8892-6ff234c6f912): created successfully
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbff2ce9-8805-4e21-8f6f-e520f65ef02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (f2f484df-9957-4e3b-aec1-8d2b7bc0c7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:23 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cfb8a7d3-5066-4288-9522-b17525179e29 tempest-VolumesActionsTest-2043751323 None] Created volume successfully.
Apr 06 16:52:24 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133 1073741824" returned: 0 in 0.681s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:24 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133
Apr 06 16:52:24 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-786947d0-4531-4734-8892-6ff234c6f912-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Lock "cinder-786947d0-4531-4734-8892-6ff234c6f912-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-quobyte-786947d0-4531-4734-8892-6ff234c6f912" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-786947d0-4531-4734-8892-6ff234c6f912" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:25 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133" returned: 0 in 0.543s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a363d28-c102-467d-8df5-a45748593d68]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de091ef4-ae70-4fce-b459-fb5b7c7f2c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9004e314-d7bc-458d-9f31-8a883ad2e133', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f3c5f6-e2fc-49d6-a17d-f74238afb9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Volume volume-9004e314-d7bc-458d-9f31-8a883ad2e133 (9004e314-d7bc-458d-9f31-8a883ad2e133): created successfully
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f3c5f6-e2fc-49d6-a17d-f74238afb9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Flow 'volume_create_manager' (8808d72c-ffb3-4ff5-9f6a-aa86a44bb612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a40e3a28-a6ca-4e2e-b791-a1369bca93a1 tempest-VolumesListAdminTestJSON-1197273611 None] Created volume successfully.
Apr 06 16:52:25 devstack sudo[85775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912
Apr 06 16:52:25 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Flow 'volume_create_manager' (1d87d794-7487-44f0-93b9-fa7f887d77bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff16e69-9519-4f45-8ba3-1d7f330d2b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff16e69-9519-4f45-8ba3-1d7f330d2b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-727935546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac9dafd-2c8f-4773-b9d8-1f658e23a801,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d72e35acd3fd4f3d90876ee168c7e53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:26Z,use_quota=True,user_id='3c097493fcd344039d36da2aee545e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bb1ec7-a636-43f4-a4c9-e5f0eec80ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bb1ec7-a636-43f4-a4c9-e5f0eec80ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe726675-d140-40de-91db-799dae349967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe726675-d140-40de-91db-799dae349967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac9dafd-2c8f-4773-b9d8-1f658e23a801', 'volume_name': 'volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c0eb2-07f1-48dd-89ba-0d7798a50985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8c0eb2-07f1-48dd-89ba-0d7798a50985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488be532-de00-4151-854a-be71772a6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Volume 5ac9dafd-2c8f-4773-b9d8-1f658e23a801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801', 'volume_size': 1}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-727935546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac9dafd-2c8f-4773-b9d8-1f658e23a801,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d72e35acd3fd4f3d90876ee168c7e53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:26Z,use_quota=True,user_id='3c097493fcd344039d36da2aee545e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Creating volume 5ac9dafd-2c8f-4773-b9d8-1f658e23a801 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:25 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:25 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912" returned: 0 in 0.520s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:25 devstack sudo[85781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 1073741824
Apr 06 16:52:25 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:25 devstack sudo[85782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912
Apr 06 16:52:25 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Flow 'volume_create_manager' (085c4d68-fa3c-4af9-a976-14fbf43782a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149e5ff7-7a4e-4a13-8666-2a98706ea8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149e5ff7-7a4e-4a13-8666-2a98706ea8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b762a5-424b-4928-8b2c-2981c1be55f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49cb6b65a464ad2b3fde6ddce8ac1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:26Z,use_quota=True,user_id='c6213691269d4b7ca5cff9cbd6616ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c478262-2bf2-40f6-93d4-af6aa8d8245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c478262-2bf2-40f6-93d4-af6aa8d8245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e450178-b435-42ab-90d7-954ad8e45239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e450178-b435-42ab-90d7-954ad8e45239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b762a5-424b-4928-8b2c-2981c1be55f3', 'volume_name': 'volume-31b762a5-424b-4928-8b2c-2981c1be55f3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9778a47a-31e4-4514-b989-2693bc216de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9778a47a-31e4-4514-b989-2693bc216de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93256ad6-2621-4fbe-a25b-195208256d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Volume 31b762a5-424b-4928-8b2c-2981c1be55f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b762a5-424b-4928-8b2c-2981c1be55f3', 'volume_size': 1}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:26 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 1073741824" returned: 0 in 0.548s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:26 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-786947d0-4531-4734-8892-6ff234c6f912" returned: 0 in 0.576s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:26 devstack sudo[85789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801
Apr 06 16:52:26 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-786947d0-4531-4734-8892-6ff234c6f912" released by "delete_volume" :: held 1.130s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Created reservations ['b80606a6-f0c4-4f7e-9ea3-cc2f226d5a2d', '3e15c05b-bde3-4a38-aab9-83d2542760de', 'd71badd2-dc66-4f42-854c-30b51e619bde', 'e06b6dd6-adef-422d-80ba-e5ac41a7a314'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:26 devstack sudo[85791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:26 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:26 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801" returned: 0 in 0.483s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b762a5-424b-4928-8b2c-2981c1be55f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49cb6b65a464ad2b3fde6ddce8ac1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:26Z,use_quota=True,user_id='c6213691269d4b7ca5cff9cbd6616ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Creating volume 31b762a5-424b-4928-8b2c-2981c1be55f3 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:26 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488be532-de00-4151-854a-be71772a6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:26 devstack sudo[85798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3 1073741824
Apr 06 16:52:26 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcff8748-f0ff-490e-ad75-ead13534efa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Volume volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 (5ac9dafd-2c8f-4773-b9d8-1f658e23a801): created successfully
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcff8748-f0ff-490e-ad75-ead13534efa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Flow 'volume_create_manager' (1d87d794-7487-44f0-93b9-fa7f887d77bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-441373fa-404d-4aac-8f60-23d5667ff2de req-dd450e85-d6ff-4b78-9bb9-0018f66719f0 tempest-VolumesGetTestJSON-1946123079 None] Created volume successfully.
Apr 06 16:52:26 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.469s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Deleted volume successfully.
Apr 06 16:52:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6558a74b-c087-4307-a48c-1a0fbe33e53f tempest-VolumesActionsTest-893773844 None] Lock "cinder-786947d0-4531-4734-8892-6ff234c6f912-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:27 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3 1073741824" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:27 devstack sudo[85806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3
Apr 06 16:52:27 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (38a211e6-b3a9-4a37-9a55-d22d8a5b9532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3b17fb-873c-48f1-8d83-6c5b385ab2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3b17fb-873c-48f1-8d83-6c5b385ab2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223801159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b261fe8-5353-4e4a-9ef7-8005917384e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:28Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb8d4fe-5b09-4b04-a1d1-76694bb138f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb8d4fe-5b09-4b04-a1d1-76694bb138f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c49cea-39c6-408c-8479-0b30e4d42d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c49cea-39c6-408c-8479-0b30e4d42d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b261fe8-5353-4e4a-9ef7-8005917384e7', 'volume_name': 'volume-3b261fe8-5353-4e4a-9ef7-8005917384e7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaf4adb-ac8f-41ae-ac66-6d21fd769a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaf4adb-ac8f-41ae-ac66-6d21fd769a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa66c6-6bfc-46e9-a017-065960908b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:27 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Volume 3b261fe8-5353-4e4a-9ef7-8005917384e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b261fe8-5353-4e4a-9ef7-8005917384e7', 'volume_size': 1}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:27 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223801159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b261fe8-5353-4e4a-9ef7-8005917384e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:28Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Creating volume 3b261fe8-5353-4e4a-9ef7-8005917384e7 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:27 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93256ad6-2621-4fbe-a25b-195208256d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b762a5-424b-4928-8b2c-2981c1be55f3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:27 devstack sudo[85809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 1073741824
Apr 06 16:52:27 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9a2f8d-a384-4e7a-acb4-3564815f0dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:27 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Volume volume-31b762a5-424b-4928-8b2c-2981c1be55f3 (31b762a5-424b-4928-8b2c-2981c1be55f3): created successfully
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9a2f8d-a384-4e7a-acb4-3564815f0dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Flow 'volume_create_manager' (085c4d68-fa3c-4af9-a976-14fbf43782a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:27 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ddc403dc-129a-4e48-8d76-008e08e2f2ea tempest-VolumesListAdminTestJSON-2037763491 None] Created volume successfully.
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Acquiring lock "cinder-5ac9dafd-2c8f-4773-b9d8-1f658e23a801-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Lock "cinder-5ac9dafd-2c8f-4773-b9d8-1f658e23a801-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Acquiring lock "cinder-quobyte-5ac9dafd-2c8f-4773-b9d8-1f658e23a801" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Lock "cinder-quobyte-5ac9dafd-2c8f-4773-b9d8-1f658e23a801" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa381a-b6ff-4e29-abbe-316ca90ee9ec]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:28 devstack sudo[85811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801
Apr 06 16:52:28 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:28 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 1073741824" returned: 0 in 0.561s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Acquiring lock "cinder-31b762a5-424b-4928-8b2c-2981c1be55f3-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Lock "cinder-31b762a5-424b-4928-8b2c-2981c1be55f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:28 devstack sudo[85816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7
Apr 06 16:52:28 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Acquiring lock "cinder-quobyte-31b762a5-424b-4928-8b2c-2981c1be55f3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Lock "cinder-quobyte-31b762a5-424b-4928-8b2c-2981c1be55f3" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5a9e52-9cdd-45c6-80f3-0e6ea7f096f4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "cinder-9004e314-d7bc-458d-9f31-8a883ad2e133-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-9004e314-d7bc-458d-9f31-8a883ad2e133-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:28 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3
Apr 06 16:52:28 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "cinder-quobyte-9004e314-d7bc-458d-9f31-8a883ad2e133" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-quobyte-9004e314-d7bc-458d-9f31-8a883ad2e133" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9816cb52-e763-4066-b104-bc8188c0e6dc]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:28 devstack sudo[85821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133
Apr 06 16:52:28 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:28 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801" returned: 0 in 0.587s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:28 devstack sudo[85825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801
Apr 06 16:52:28 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:28 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa66c6-6bfc-46e9-a017-065960908b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b261fe8-5353-4e4a-9ef7-8005917384e7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de8a1a6-1c2a-4273-8341-35fbe2867e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:28 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Volume volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 (3b261fe8-5353-4e4a-9ef7-8005917384e7): created successfully
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de8a1a6-1c2a-4273-8341-35fbe2867e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (38a211e6-b3a9-4a37-9a55-d22d8a5b9532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:28 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-52ec6c0b-7520-41f5-9377-63e9a05c144d tempest-VolumesActionsTest-2043751323 None] Created volume successfully.
Apr 06 16:52:28 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3" returned: 0 in 0.539s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:28 devstack sudo[85831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3
Apr 06 16:52:28 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:29 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133" returned: 0 in 0.519s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:29 devstack sudo[85837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133
Apr 06 16:52:29 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:29 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5ac9dafd-2c8f-4773-b9d8-1f658e23a801" returned: 0 in 0.440s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Lock "cinder-quobyte-5ac9dafd-2c8f-4773-b9d8-1f658e23a801" released by "delete_volume" :: held 1.061s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.quota [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Created reservations ['d2aaa518-b727-42ff-8cbe-87204d9d933d', '63e8a2c0-0e55-4f83-87c7-6542a6c328ac', '51d278ea-f837-460d-8387-ed6730b959c0', 'f70304b7-02a1-4681-ab44-a07fdde12056'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:29 devstack sudo[85839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:29 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:29 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-31b762a5-424b-4928-8b2c-2981c1be55f3" returned: 0 in 0.497s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Lock "cinder-quobyte-31b762a5-424b-4928-8b2c-2981c1be55f3" released by "delete_volume" :: held 1.060s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:29 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9004e314-d7bc-458d-9f31-8a883ad2e133" returned: 0 in 0.411s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Created reservations ['a6452433-2edc-43c2-9d88-229fba3c15ed', 'b18b1a33-292b-4b5f-be55-a433ace3818d', '0a01db45-e18a-4896-8c5d-2e5ada2696e0', '89292bf7-050a-446c-adaf-656c043bbf8f'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-quobyte-9004e314-d7bc-458d-9f31-8a883ad2e133" released by "delete_volume" :: held 0.959s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:29 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:29 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Created reservations ['f640aa87-7de1-47a9-8b2f-f9b1a1af568c', 'a9aa197e-900a-4c81-b46a-21aee2374b2f', 'aa6f2086-4887-4cab-8501-7e5ac0486f10', '8400689c-7803-4cf5-bf01-4f91ad9778a7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:29 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.430s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.manager [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Deleted volume successfully.
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-dc82490d-b9c7-4b34-a05f-50076382482d req-b78d52de-b147-4954-ad50-f9ffc795e756 tempest-VolumesGetTestJSON-1946123079 None] Lock "cinder-5ac9dafd-2c8f-4773-b9d8-1f658e23a801-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:29 devstack sudo[85846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:29 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-3b261fe8-5353-4e4a-9ef7-8005917384e7-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Lock "cinder-3b261fe8-5353-4e4a-9ef7-8005917384e7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Acquiring lock "cinder-quobyte-3b261fe8-5353-4e4a-9ef7-8005917384e7" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-3b261fe8-5353-4e4a-9ef7-8005917384e7" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd668c26-d236-4f0a-b6aa-2b54905a6614]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:29 devstack sudo[85848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7
Apr 06 16:52:29 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:29 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.464s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Deleted volume successfully.
Apr 06 16:52:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-102a1a95-bb0b-443d-966c-63e280e9053e tempest-VolumesListAdminTestJSON-2037763491 None] Lock "cinder-31b762a5-424b-4928-8b2c-2981c1be55f3-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:30 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.475s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Deleted volume successfully.
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c505b53-d76e-4f42-9e35-6d9e3da21eb1 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-9004e314-d7bc-458d-9f31-8a883ad2e133-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:30 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7" returned: 0 in 0.531s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:30 devstack sudo[85855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7
Apr 06 16:52:30 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "cinder-b73cc144-58ce-4f69-9fec-ce4bfc6e2734-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-b73cc144-58ce-4f69-9fec-ce4bfc6e2734-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "cinder-quobyte-b73cc144-58ce-4f69-9fec-ce4bfc6e2734" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-quobyte-b73cc144-58ce-4f69-9fec-ce4bfc6e2734" acquired by "delete_volume" :: waited 0.020s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c11eb7-3c8e-4c0b-bfe9-bf8bd338ada2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:30 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734
Apr 06 16:52:30 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:30 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3b261fe8-5353-4e4a-9ef7-8005917384e7" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Lock "cinder-quobyte-3b261fe8-5353-4e4a-9ef7-8005917384e7" released by "delete_volume" :: held 1.040s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Created reservations ['356105d4-8f9b-4a99-9c08-e7733e9bfd4a', '77c09cbc-eee9-4ae9-83b2-7b683c661e4e', 'e94bec77-112e-4937-bde4-a868aabbcb90', 'f4554912-0e1e-446e-8d7d-c090d89424e0'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:30 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:30 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:31 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734" returned: 0 in 0.678s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:31 devstack sudo[85865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734
Apr 06 16:52:31 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:31 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.558s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:31 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Deleted volume successfully.
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-677ef044-7172-45ed-9558-8e94a85167f0 tempest-VolumesActionsTest-893773844 None] Lock "cinder-3b261fe8-5353-4e4a-9ef7-8005917384e7-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:31 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b73cc144-58ce-4f69-9fec-ce4bfc6e2734" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-quobyte-b73cc144-58ce-4f69-9fec-ce4bfc6e2734" released by "delete_volume" :: held 1.178s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:31 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Created reservations ['99928cbb-8f16-4ad6-94bb-578f399aa940', 'b4dfbe5a-4cbd-405c-b813-6885c23b4f39', '3fde7d7c-5da9-4db5-a044-3363dce71af6', 'a2f13ed0-9b63-4844-b250-413140470254'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:32 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:32 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (c0d733f1-bfdc-46c5-a2d8-67adc0fdd38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228105db-9abb-4245-aa23-0c2e6aea4530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228105db-9abb-4245-aa23-0c2e6aea4530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-387515621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8276bf-1d0a-4687-88f7-c259a8973a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:32Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10605ac6-5238-4ef8-8982-bbc01feb9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10605ac6-5238-4ef8-8982-bbc01feb9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec191a2-6143-4e37-92da-f5148e9d6cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec191a2-6143-4e37-92da-f5148e9d6cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8276bf-1d0a-4687-88f7-c259a8973a96', 'volume_name': 'volume-3f8276bf-1d0a-4687-88f7-c259a8973a96', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020a23fa-9b6e-436b-a68b-e080abc7c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020a23fa-9b6e-436b-a68b-e080abc7c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19bbc62-8909-4196-a594-dfe8f228cc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:32 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Volume 3f8276bf-1d0a-4687-88f7-c259a8973a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8276bf-1d0a-4687-88f7-c259a8973a96', 'volume_size': 1}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-387515621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8276bf-1d0a-4687-88f7-c259a8973a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041ce094bf5d469b9eb95d47d6ae3627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:32Z,use_quota=True,user_id='0e9600ac381343468dcaa9e91b101d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Creating volume 3f8276bf-1d0a-4687-88f7-c259a8973a96 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:32 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:32 devstack sudo[85872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 1073741824
Apr 06 16:52:32 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:32 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.612s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:32 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Deleted volume successfully.
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-27886753-f46c-49fe-8fa8-6c6961e2a371 tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-b73cc144-58ce-4f69-9fec-ce4bfc6e2734-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "cinder-f2f87e06-ad82-472b-b393-cd35973f6ad6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-f2f87e06-ad82-472b-b393-cd35973f6ad6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Flow 'volume_create_manager' (b93d2939-86dc-4dbd-9833-ad80f7b590ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa23686-5add-4474-b030-5dae5e0e0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa23686-5add-4474-b030-5dae5e0e0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1274436519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d06efe-4cc0-455d-9864-ca6c7bae1fc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb32181881644b8ea0e3b9d04dc60bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:33Z,use_quota=True,user_id='095d24eaca554d7f8b467168485dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a090911-e33b-4697-8e69-b6f5819899e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a090911-e33b-4697-8e69-b6f5819899e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e01872-29e3-4574-8495-661f3eb5fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e01872-29e3-4574-8495-661f3eb5fc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d06efe-4cc0-455d-9864-ca6c7bae1fc1', 'volume_name': 'volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7395de-cde0-450b-aac5-549948cff970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7395de-cde0-450b-aac5-549948cff970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334ee852-d9ca-421f-b50f-39c26c528b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Volume d7d06efe-4cc0-455d-9864-ca6c7bae1fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1', 'volume_size': 1}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "cinder-quobyte-f2f87e06-ad82-472b-b393-cd35973f6ad6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-quobyte-f2f87e06-ad82-472b-b393-cd35973f6ad6" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e1b5e2-6529-44e1-80f3-29b320937ed6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:33 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 1073741824" returned: 0 in 0.657s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:33 devstack sudo[85883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96
Apr 06 16:52:33 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:33 devstack sudo[85879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6
Apr 06 16:52:33 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:33 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96" returned: 0 in 0.448s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1274436519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d06efe-4cc0-455d-9864-ca6c7bae1fc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb32181881644b8ea0e3b9d04dc60bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:33Z,use_quota=True,user_id='095d24eaca554d7f8b467168485dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Creating volume d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:33 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19bbc62-8909-4196-a594-dfe8f228cc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8276bf-1d0a-4687-88f7-c259a8973a96', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dc32f8-cab9-4f7c-bafa-3f2995ef1d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:33 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 1073741824
Apr 06 16:52:33 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Volume volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 (3f8276bf-1d0a-4687-88f7-c259a8973a96): created successfully
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dc32f8-cab9-4f7c-bafa-3f2995ef1d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Flow 'volume_create_manager' (c0d733f1-bfdc-46c5-a2d8-67adc0fdd38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-16c64226-d8e0-433c-a631-14cc715da580 tempest-VolumesActionsTest-2043751323 None] Created volume successfully.
Apr 06 16:52:33 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6" returned: 0 in 0.552s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:33 devstack sudo[85905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6
Apr 06 16:52:33 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:34 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f2f87e06-ad82-472b-b393-cd35973f6ad6" returned: 0 in 0.453s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-quobyte-f2f87e06-ad82-472b-b393-cd35973f6ad6" released by "delete_volume" :: held 1.036s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:34 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 1073741824" returned: 0 in 0.528s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:34 devstack sudo[85911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1
Apr 06 16:52:34 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Created reservations ['acfc380b-b408-4e52-bb45-db5e31d6595d', 'ae7b2193-0094-420d-8a59-bbbf5dd66c46', 'b7106008-353f-4725-802d-3a32172790fb', '267255b9-63ba-49f3-aa35-10528a4013e1'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:34 devstack sudo[85913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:34 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:34 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1" returned: 0 in 0.405s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334ee852-d9ca-421f-b50f-39c26c528b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c268ec-a65c-4a60-8970-67880fb59d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Volume volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 (d7d06efe-4cc0-455d-9864-ca6c7bae1fc1): created successfully
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c268ec-a65c-4a60-8970-67880fb59d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Flow 'volume_create_manager' (b93d2939-86dc-4dbd-9833-ad80f7b590ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fbaba5ac-95ef-41a2-b73e-d63042d3624b tempest-VolumesTestJSON-1777047784 None] Created volume successfully.
Apr 06 16:52:34 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.454s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Deleted volume successfully.
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf2b34f1-726e-444a-8903-e2eed629208c tempest-VolumesListAdminTestJSON-1197273611 None] Lock "cinder-f2f87e06-ad82-472b-b393-cd35973f6ad6-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "cinder-3f8276bf-1d0a-4687-88f7-c259a8973a96-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-3f8276bf-1d0a-4687-88f7-c259a8973a96-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "cinder-quobyte-3f8276bf-1d0a-4687-88f7-c259a8973a96" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-quobyte-3f8276bf-1d0a-4687-88f7-c259a8973a96" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b30a0-4651-4e36-8f3f-929fec83da1f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:35 devstack sudo[85917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96
Apr 06 16:52:35 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Flow 'volume_create_manager' (3c30eeb3-3b99-437a-81ce-afdaead88e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1fc272-6670-4d44-b2fb-c2bc6b9bc9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1fc272-6670-4d44-b2fb-c2bc6b9bc9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-556716508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a310b695-5390-46a2-a5d0-b6d269e70c66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb32181881644b8ea0e3b9d04dc60bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:35Z,use_quota=True,user_id='095d24eaca554d7f8b467168485dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c380522-8726-4fd9-991c-9d6ca335a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c380522-8726-4fd9-991c-9d6ca335a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8dc6be-74a6-4571-bfb2-25d01442effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8dc6be-74a6-4571-bfb2-25d01442effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a310b695-5390-46a2-a5d0-b6d269e70c66', 'volume_name': 'volume-a310b695-5390-46a2-a5d0-b6d269e70c66', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011dc23c-57c9-4bac-8ef4-f2a1fa5ccd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011dc23c-57c9-4bac-8ef4-f2a1fa5ccd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afa8085-e835-4bd8-9dc7-11df65ba53c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:35 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Volume a310b695-5390-46a2-a5d0-b6d269e70c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a310b695-5390-46a2-a5d0-b6d269e70c66', 'volume_size': 1}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-556716508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a310b695-5390-46a2-a5d0-b6d269e70c66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb32181881644b8ea0e3b9d04dc60bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:35Z,use_quota=True,user_id='095d24eaca554d7f8b467168485dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Creating volume a310b695-5390-46a2-a5d0-b6d269e70c66 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:35 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:35 devstack sudo[85922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66 1073741824
Apr 06 16:52:35 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:35 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96" returned: 0 in 0.552s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:35 devstack sudo[85924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96
Apr 06 16:52:35 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:35 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:35 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66 1073741824" returned: 0 in 0.536s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3f8276bf-1d0a-4687-88f7-c259a8973a96" returned: 0 in 0.477s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-quobyte-3f8276bf-1d0a-4687-88f7-c259a8973a96" released by "delete_volume" :: held 1.067s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:36 devstack sudo[85930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66
Apr 06 16:52:36 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Created reservations ['17d5ae20-6f65-4e82-a423-5190942ab4c9', '318ca41a-a451-4f85-b241-f56e2f63b0e8', 'bc844580-94ab-4550-9301-709d5c97af58', '118d10eb-febf-4acd-9f24-6824cd2fdf18'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:36 devstack sudo[85932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:36 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:36 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afa8085-e835-4bd8-9dc7-11df65ba53c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a310b695-5390-46a2-a5d0-b6d269e70c66', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ed28ef-9199-471b-8df7-a3068c8735a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:36 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Volume volume-a310b695-5390-46a2-a5d0-b6d269e70c66 (a310b695-5390-46a2-a5d0-b6d269e70c66): created successfully
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ed28ef-9199-471b-8df7-a3068c8735a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Flow 'volume_create_manager' (3c30eeb3-3b99-437a-81ce-afdaead88e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ce8842d5-7f07-481c-852e-b2b22a8ec4e0 tempest-VolumesTestJSON-1777047784 None] Created volume successfully.
Apr 06 16:52:36 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.488s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Deleted volume successfully.
Apr 06 16:52:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a24208f0-f945-449b-9b6d-fa070baf8864 tempest-VolumesActionsTest-2043751323 None] Lock "cinder-3f8276bf-1d0a-4687-88f7-c259a8973a96-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Flow 'volume_create_manager' (6d8e26a8-9f79-4732-a816-ddac029033ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635e1934-82d8-4443-8a4a-15f642b6dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635e1934-82d8-4443-8a4a-15f642b6dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1853334427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ddef27-75ce-40e9-be11-0e712d8d746d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb32181881644b8ea0e3b9d04dc60bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:38Z,use_quota=True,user_id='095d24eaca554d7f8b467168485dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c598fd-c894-4ba0-9d04-8c69d9f9b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c598fd-c894-4ba0-9d04-8c69d9f9b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d18cd2-6a8c-47aa-83fa-2b73822d35c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d18cd2-6a8c-47aa-83fa-2b73822d35c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ddef27-75ce-40e9-be11-0e712d8d746d', 'volume_name': 'volume-84ddef27-75ce-40e9-be11-0e712d8d746d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7547fe9c-555d-4235-b9cd-bf752d698734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7547fe9c-555d-4235-b9cd-bf752d698734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88ecf33-2e07-49e4-8b29-3cf179321114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:37 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Volume 84ddef27-75ce-40e9-be11-0e712d8d746d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ddef27-75ce-40e9-be11-0e712d8d746d', 'volume_size': 1}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1853334427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ddef27-75ce-40e9-be11-0e712d8d746d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb32181881644b8ea0e3b9d04dc60bd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:38Z,use_quota=True,user_id='095d24eaca554d7f8b467168485dfe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Creating volume 84ddef27-75ce-40e9-be11-0e712d8d746d {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:37 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:37 devstack sudo[85939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d 1073741824
Apr 06 16:52:37 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:38 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d 1073741824" returned: 0 in 0.804s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:38 devstack sudo[85972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d
Apr 06 16:52:38 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:39 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d" returned: 0 in 0.842s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88ecf33-2e07-49e4-8b29-3cf179321114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ddef27-75ce-40e9-be11-0e712d8d746d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eeb60b-1d85-4e08-8f0d-c22929ad6334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:39 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Volume volume-84ddef27-75ce-40e9-be11-0e712d8d746d (84ddef27-75ce-40e9-be11-0e712d8d746d): created successfully
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eeb60b-1d85-4e08-8f0d-c22929ad6334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Flow 'volume_create_manager' (6d8e26a8-9f79-4732-a816-ddac029033ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6cba3b00-9640-46e4-be04-40b8d4c08d24 tempest-VolumesTestJSON-1777047784 None] Created volume successfully.
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Flow 'volume_create_manager' (02812fe0-ba84-45f3-a14b-65dacbfb5df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60cd2b4-f51f-4406-bc3b-c0ae746cdfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60cd2b4-f51f-4406-bc3b-c0ae746cdfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-592541777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58f9af1-5449-4e48-a1d4-f74771a320ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f132af8d9ce943ad82741bae4e87facb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:40Z,use_quota=True,user_id='b5de899ab83142b5a901f75bb6a2a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a266ee1f-1f2a-494b-8308-3dd5b3ededef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a266ee1f-1f2a-494b-8308-3dd5b3ededef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb53db8-62aa-4fdd-97cf-50de0ed423c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb53db8-62aa-4fdd-97cf-50de0ed423c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58f9af1-5449-4e48-a1d4-f74771a320ad', 'volume_name': 'volume-f58f9af1-5449-4e48-a1d4-f74771a320ad', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877137bd-fa75-4f9f-9eea-d849df6eeed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877137bd-fa75-4f9f-9eea-d849df6eeed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a164d84c-9158-4500-8fb5-bc239bd6ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:40 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Volume f58f9af1-5449-4e48-a1d4-f74771a320ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58f9af1-5449-4e48-a1d4-f74771a320ad', 'volume_size': 1}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-592541777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58f9af1-5449-4e48-a1d4-f74771a320ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f132af8d9ce943ad82741bae4e87facb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:40Z,use_quota=True,user_id='b5de899ab83142b5a901f75bb6a2a8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Creating volume f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:40 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:40 devstack sudo[85978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad 1073741824
Apr 06 16:52:40 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "cinder-84ddef27-75ce-40e9-be11-0e712d8d746d-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-84ddef27-75ce-40e9-be11-0e712d8d746d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "cinder-quobyte-84ddef27-75ce-40e9-be11-0e712d8d746d" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-quobyte-84ddef27-75ce-40e9-be11-0e712d8d746d" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fd13a4-f17c-4276-b980-516e8c82c98b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:41 devstack sudo[85980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d
Apr 06 16:52:41 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:41 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad 1073741824" returned: 0 in 0.941s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:41 devstack sudo[85990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad
Apr 06 16:52:41 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:41 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d" returned: 0 in 0.589s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:41 devstack sudo[85992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d
Apr 06 16:52:41 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:42 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad" returned: 0 in 0.474s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a164d84c-9158-4500-8fb5-bc239bd6ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58f9af1-5449-4e48-a1d4-f74771a320ad', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2029924-aae1-4ff2-9e8e-4bf07df63b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:42 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Volume volume-f58f9af1-5449-4e48-a1d4-f74771a320ad (f58f9af1-5449-4e48-a1d4-f74771a320ad): created successfully
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2029924-aae1-4ff2-9e8e-4bf07df63b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Flow 'volume_create_manager' (02812fe0-ba84-45f3-a14b-65dacbfb5df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-95d856fd-f2b6-4aa5-9871-2b2d89de0c61 tempest-SnapshotMetadataTestJSON-271965285 None] Created volume successfully.
Apr 06 16:52:42 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-84ddef27-75ce-40e9-be11-0e712d8d746d" returned: 0 in 0.496s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-quobyte-84ddef27-75ce-40e9-be11-0e712d8d746d" released by "delete_volume" :: held 1.135s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Created reservations ['0518152a-b3d5-4a43-aa16-93d603964028', '0ac46a50-26cb-4bf4-860b-1ea8abdbc51c', '08d47f9f-1e6f-4737-b837-1de5c5b0798e', '1ce24cd4-6bfd-41f0-b118-ca2b1e7ef9d4'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:42 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:42 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Creating offline snapshot 51930fdb-3473-4514-a773-4f901de0ada5 of volume f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:52:42 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.558s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Deleted volume successfully.
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4ce163-1ae1-4645-9175-d2956840d81b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-68189f07-c0c1-44c8-a87a-18cff6f1c4b3 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-84ddef27-75ce-40e9-be11-0e712d8d746d-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:42 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad
Apr 06 16:52:42 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "cinder-a310b695-5390-46a2-a5d0-b6d269e70c66-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-a310b695-5390-46a2-a5d0-b6d269e70c66-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "cinder-quobyte-a310b695-5390-46a2-a5d0-b6d269e70c66" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-quobyte-a310b695-5390-46a2-a5d0-b6d269e70c66" acquired by "delete_volume" :: waited 0.020s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb580b1-90ae-4db2-ba1a-e90bccb03b95]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:43 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad" returned: 0 in 0.582s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:43 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66
Apr 06 16:52:43 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:43 devstack sudo[86008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 1G
Apr 06 16:52:43 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:43 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66" returned: 0 in 0.611s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:44 devstack sudo[86017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66
Apr 06 16:52:44 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:44 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 1G" returned: 0 in 0.631s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f58f9af1-5449-4e48-a1d4-f74771a320ad -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:44 devstack sudo[86019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f58f9af1-5449-4e48-a1d4-f74771a320ad -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5
Apr 06 16:52:44 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:44 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a310b695-5390-46a2-a5d0-b6d269e70c66" returned: 0 in 0.497s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-quobyte-a310b695-5390-46a2-a5d0-b6d269e70c66" released by "delete_volume" :: held 1.137s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Created reservations ['ee17d7b1-abf1-4a4c-9754-5b4009d817d3', '0699bb27-343c-4ab7-a6b6-15763401f5eb', 'f74dff32-2f05-4f4a-a64f-82f9842fff17', '6942eafd-feb3-4744-a929-fac545280ad2'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:44 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:44 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:44 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f58f9af1-5449-4e48-a1d4-f74771a320ad -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5" returned: 0 in 0.794s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:44 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 is being set with open permissions: ugo+rw
Apr 06 16:52:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:44 devstack sudo[86035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5
Apr 06 16:52:44 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:45 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.506s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:45 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Deleted volume successfully.
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1eafe72b-71d0-4f5c-8118-b2b7e7ca1270 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-a310b695-5390-46a2-a5d0-b6d269e70c66-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:45 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:45 devstack sudo[86053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info
Apr 06 16:52:45 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "cinder-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "cinder-quobyte-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-quobyte-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe40f686-50e5-4e70-9dbb-92bc509cc18b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:45 devstack sudo[86055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1
Apr 06 16:52:45 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:45 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:45 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info is being set with open permissions: ugo+rw
Apr 06 16:52:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:45 devstack sudo[86058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info
Apr 06 16:52:45 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:46 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1" returned: 0 in 0.662s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:46 devstack sudo[86063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1
Apr 06 16:52:46 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:46 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.info" returned: 0 in 0.661s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.728s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:46 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-922417c0-ec95-4db7-b720-eb0a7463508e tempest-SnapshotMetadataTestJSON-271965285 None] Create snapshot completed successfully
Apr 06 16:52:46 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1" returned: 0 in 0.585s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-quobyte-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1" released by "delete_volume" :: held 1.269s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Created reservations ['a268ce35-7266-426d-8d3a-96856d31dd4d', '242c4817-b73c-43c3-a8d6-008eb7c85a1d', '499ffff8-f8ac-407f-b239-7ad4e0f8de8f', 'aa19a6d9-0976-430b-b35c-de146524b306'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:46 devstack sudo[86067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:46 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:47 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Deleted volume successfully.
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be35239a-2aec-4df4-82d9-1d764155df61 tempest-VolumesTestJSON-1777047784 None] Lock "cinder-d7d06efe-4cc0-455d-9864-ca6c7bae1fc1-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "cinder-51930fdb-3473-4514-a773-4f901de0ada5-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-51930fdb-3473-4514-a773-4f901de0ada5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "cinder-quobyte-f58f9af1-5449-4e48-a1d4-f74771a320ad" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-quobyte-f58f9af1-5449-4e48-a1d4-f74771a320ad" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "cinder-quobyte-51930fdb-3473-4514-a773-4f901de0ada5" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-quobyte-51930fdb-3473-4514-a773-4f901de0ada5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Deleting offline snapshot 51930fdb-3473-4514-a773-4f901de0ada5 of volume f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] snapshot_file for this snap is: volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2227e6ae-c3ff-4040-b7eb-e344aeb5ec60]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:48 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5
Apr 06 16:52:48 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Flow 'volume_create_manager' (9c0a1362-a0ba-4bc8-8e02-38049821ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c53df-3773-4333-b0bb-83bda6974425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c53df-3773-4333-b0bb-83bda6974425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1432131556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c48421f-cfc1-44bd-8184-44bcc7fea09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b982980a174acbbb24fd5c23d3a7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:49Z,use_quota=True,user_id='197ba80e4773422ca706b07dccdb151a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271fc779-26ad-45a3-af3f-0071f65a9981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271fc779-26ad-45a3-af3f-0071f65a9981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58f51b7-fd96-4424-9cc7-82d033875964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58f51b7-fd96-4424-9cc7-82d033875964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c48421f-cfc1-44bd-8184-44bcc7fea09c', 'volume_name': 'volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdf2744-3a10-46af-bf2e-d944cd278f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdf2744-3a10-46af-bf2e-d944cd278f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2baf997-2ffe-434b-a965-ce9f13ce8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:48 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Volume 5c48421f-cfc1-44bd-8184-44bcc7fea09c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c', 'volume_size': 1}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1432131556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c48421f-cfc1-44bd-8184-44bcc7fea09c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b982980a174acbbb24fd5c23d3a7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:49Z,use_quota=True,user_id='197ba80e4773422ca706b07dccdb151a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Creating volume 5c48421f-cfc1-44bd-8184-44bcc7fea09c {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:48 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:48 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5" returned: 0 in 0.733s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f58f9af1-5449-4e48-a1d4-f74771a320ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:52:48 devstack sudo[86076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c 1073741824
Apr 06 16:52:48 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f0b31-8f15-4d8d-ad91-5ddb2d0d49cd]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:48 devstack sudo[86078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad
Apr 06 16:52:48 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:49 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad" returned: 0 in 0.554s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:49 devstack sudo[86086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5
Apr 06 16:52:49 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:49 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c 1073741824" returned: 0 in 0.644s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:49 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c
Apr 06 16:52:49 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:49 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5" returned: 0 in 0.712s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:49 devstack sudo[86094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5
Apr 06 16:52:49 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:50 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c" returned: 0 in 0.713s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2baf997-2ffe-434b-a965-ce9f13ce8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3057b4ea-8cf2-4854-b21d-e80b9e5a2027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:50 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Volume volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c (5c48421f-cfc1-44bd-8184-44bcc7fea09c): created successfully
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3057b4ea-8cf2-4854-b21d-e80b9e5a2027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Flow 'volume_create_manager' (9c0a1362-a0ba-4bc8-8e02-38049821ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9fddd6de-02d1-435e-b6fd-8bf9651cc4b9 tempest-VolumesTransfersV357Test-1264556781 None] Created volume successfully.
Apr 06 16:52:50 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad.51930fdb-3473-4514-a773-4f901de0ada5" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-quobyte-51930fdb-3473-4514-a773-4f901de0ada5" released by "_delete_snapshot" :: held 2.565s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-quobyte-f58f9af1-5449-4e48-a1d4-f74771a320ad" released by "delete_snapshot" :: held 2.600s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Created reservations ['e998ca0d-f665-464c-b117-c2cdd0f1a2d9', '9f384a9d-db59-446c-9f79-454f43a5b148', '2854dcdf-4b7b-4115-a44f-7823b477403d', 'd8b552df-dc24-498a-868e-42bba21409d1'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Delete snapshot completed successfully.
Apr 06 16:52:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fd1f945-2fd3-461f-9c40-74be978a43cd tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-51930fdb-3473-4514-a773-4f901de0ada5-delete_snapshot" released by "delete_snapshot" :: held 2.745s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "cinder-f58f9af1-5449-4e48-a1d4-f74771a320ad-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-f58f9af1-5449-4e48-a1d4-f74771a320ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "cinder-quobyte-f58f9af1-5449-4e48-a1d4-f74771a320ad" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-quobyte-f58f9af1-5449-4e48-a1d4-f74771a320ad" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b055f174-b3a2-4d8e-ba5d-6e00986e8134]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:51 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cdc3f4d2-fe5a-4c33-a323-3b3605dac3ac tempest-VolumesTransfersV357Test-1257086886 None] Transfer volume completed successfully.
Apr 06 16:52:51 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad
Apr 06 16:52:51 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:51 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:51 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad
Apr 06 16:52:51 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Acquiring lock "cinder-5c48421f-cfc1-44bd-8184-44bcc7fea09c-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-5c48421f-cfc1-44bd-8184-44bcc7fea09c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Acquiring lock "cinder-quobyte-5c48421f-cfc1-44bd-8184-44bcc7fea09c" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-quobyte-5c48421f-cfc1-44bd-8184-44bcc7fea09c" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3090c4d-409c-42cb-b280-d8e424efe15d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:52 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f58f9af1-5449-4e48-a1d4-f74771a320ad" returned: 0 in 0.723s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-quobyte-f58f9af1-5449-4e48-a1d4-f74771a320ad" released by "delete_volume" :: held 1.248s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:52 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c
Apr 06 16:52:52 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Created reservations ['4d6e797e-fa5f-4636-8b59-db7100eff938', '4261c07b-20de-4082-a420-a5ba1d372b49', '48159c30-7393-45ad-a531-a0b76050fc01', 'c186e8d9-1626-41f4-9694-0bd879f1b4c4'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:52 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:52 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:53 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.547s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Deleted volume successfully.
Apr 06 16:52:53 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c" returned: 0 in 0.718s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-94741a0c-8ea4-485e-a580-931f1ca497ee tempest-SnapshotMetadataTestJSON-271965285 None] Lock "cinder-f58f9af1-5449-4e48-a1d4-f74771a320ad-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:53 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c
Apr 06 16:52:53 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:53 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c48421f-cfc1-44bd-8184-44bcc7fea09c" returned: 0 in 0.575s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-quobyte-5c48421f-cfc1-44bd-8184-44bcc7fea09c" released by "delete_volume" :: held 1.323s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Created reservations ['cf8257f6-d816-4468-8dca-6ede2352ad15', '1c08fd63-319e-4c57-90a4-c3eeaa62fba5', '9fc43a9a-d579-4484-a991-5ae097d9265b', 'b2bb8e94-0b8f-4ae0-8ab2-bc3a5b786d2f'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:53 devstack sudo[86123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:53 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:54 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.662s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:54 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Deleted volume successfully.
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3af13782-82d1-4d5b-aa8d-87faa8274a63 tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-5c48421f-cfc1-44bd-8184-44bcc7fea09c-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Flow 'volume_create_manager' (da0e02cb-fa48-4418-8f4c-bd8e3cc52191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90edefdd-a08d-41ab-bef4-953c312ed347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90edefdd-a08d-41ab-bef4-953c312ed347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1752528775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feaa2d5-43f3-4764-9904-72350a5427f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b982980a174acbbb24fd5c23d3a7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:55Z,use_quota=True,user_id='197ba80e4773422ca706b07dccdb151a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0344c66d-c4eb-49b2-bd79-1b559a9dc3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0344c66d-c4eb-49b2-bd79-1b559a9dc3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3194d2-a6ea-4c37-afd7-54be380fc80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3194d2-a6ea-4c37-afd7-54be380fc80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7feaa2d5-43f3-4764-9904-72350a5427f6', 'volume_name': 'volume-7feaa2d5-43f3-4764-9904-72350a5427f6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040ab67b-d7fd-40ca-a2a0-21d8c0f11c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040ab67b-d7fd-40ca-a2a0-21d8c0f11c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221cb78d-37dc-4eac-aa29-fa897d584c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:54 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Volume 7feaa2d5-43f3-4764-9904-72350a5427f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7feaa2d5-43f3-4764-9904-72350a5427f6', 'volume_size': 1}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1752528775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feaa2d5-43f3-4764-9904-72350a5427f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b982980a174acbbb24fd5c23d3a7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:55Z,use_quota=True,user_id='197ba80e4773422ca706b07dccdb151a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Creating volume 7feaa2d5-43f3-4764-9904-72350a5427f6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:54 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:55 devstack sudo[86126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6 1073741824
Apr 06 16:52:55 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Flow 'volume_create_manager' (9a0f7198-0cf2-4d28-8105-a32e200e35f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67eb95c4-3559-45c4-a9c5-c8ebe669f954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67eb95c4-3559-45c4-a9c5-c8ebe669f954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1449040472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167dc96-1e38-458a-bc55-3e45db0ccfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e8de958804fe2863e6c173c323a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:55Z,use_quota=True,user_id='9bb79424b6174359bc796c7c008b5908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3265b460-66f4-43c3-bdd5-239475fce16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3265b460-66f4-43c3-bdd5-239475fce16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d734e4b-bb79-44a9-b007-bda5cfaff9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d734e4b-bb79-44a9-b007-bda5cfaff9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9167dc96-1e38-458a-bc55-3e45db0ccfcc', 'volume_name': 'volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703a469b-c458-412e-998b-3446c30776a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703a469b-c458-412e-998b-3446c30776a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bf7b04-c1b8-420e-a38b-c1ea5c9fae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:55 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc', 'volume_size': 1}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:55 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6 1073741824" returned: 0 in 0.778s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:55 devstack sudo[86131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6
Apr 06 16:52:55 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Flow 'volume_create_manager' (d27ee3b7-5a32-4773-a2c4-c9b6ef6b15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4ff311-80a7-4448-a923-e12f03ec5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4ff311-80a7-4448-a923-e12f03ec5630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1566439936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe445b47-2374-41b0-906b-01790773707f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70f2420bb23e4958becf791b895efbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:56Z,use_quota=True,user_id='a53c923452dd45f191ac074e28b2fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c27cf47-1def-4e06-acd0-056dbfc2eb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c27cf47-1def-4e06-acd0-056dbfc2eb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5612cfc2-09f2-417c-a426-dd2a74f24d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5612cfc2-09f2-417c-a426-dd2a74f24d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe445b47-2374-41b0-906b-01790773707f', 'volume_name': 'volume-fe445b47-2374-41b0-906b-01790773707f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e8dc21-42ce-481f-8337-10552445fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e8dc21-42ce-481f-8337-10552445fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e4e141-4c2c-4e08-ab8d-30d86487b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:56 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Volume fe445b47-2374-41b0-906b-01790773707f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe445b47-2374-41b0-906b-01790773707f', 'volume_size': 1}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:56 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6" returned: 0 in 0.584s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1449040472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167dc96-1e38-458a-bc55-3e45db0ccfcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='063e8de958804fe2863e6c173c323a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:55Z,use_quota=True,user_id='9bb79424b6174359bc796c7c008b5908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Creating volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:56 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221cb78d-37dc-4eac-aa29-fa897d584c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7feaa2d5-43f3-4764-9904-72350a5427f6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a98707-f368-4c05-b812-cb5dc859da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:56 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc 1073741824
Apr 06 16:52:56 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Volume volume-7feaa2d5-43f3-4764-9904-72350a5427f6 (7feaa2d5-43f3-4764-9904-72350a5427f6): created successfully
Apr 06 16:52:56 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a98707-f368-4c05-b812-cb5dc859da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Flow 'volume_create_manager' (da0e02cb-fa48-4418-8f4c-bd8e3cc52191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:56 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-80bdbfba-3235-497f-8573-46bb4553ca5f tempest-VolumesTransfersV357Test-1264556781 None] Created volume successfully.
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Flow 'volume_create_manager' (cb4ba532-48ec-4ee1-aa2c-c571b6c42a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2b3ac2-cfa0-4fa1-a878-b3bd6aec84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2b3ac2-cfa0-4fa1-a878-b3bd6aec84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4e234d-e694-4f3e-9f2f-7eae3fcbc867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a08bb19c0f4f04936c6f155914aba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:57Z,use_quota=True,user_id='c38c7aec45044a8896e8a23fa0cb1e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f4c05b-2e49-43b1-8a92-b6899ba2c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f4c05b-2e49-43b1-8a92-b6899ba2c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8eafd47-0886-44eb-a38d-63c3b4571e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.image.glance [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Creating Keystone auth plugin from conf {{(pid=82421) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 06 16:52:57 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc 1073741824" returned: 0 in 0.792s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:57 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc
Apr 06 16:52:57 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Acquiring lock "cinder-7feaa2d5-43f3-4764-9904-72350a5427f6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-7feaa2d5-43f3-4764-9904-72350a5427f6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8eafd47-0886-44eb-a38d-63c3b4571e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b4e234d-e694-4f3e-9f2f-7eae3fcbc867', 'volume_name': 'volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e1544e290>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49160bcf-def4-4b1d-a64f-2f3e7ad3364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49160bcf-def4-4b1d-a64f-2f3e7ad3364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c071169-2a2e-4c82-a1b7-ce4cb30105bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:57 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Volume 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e1544e290>}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Trying to clone 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 from image 765549bd-5564-4279-accf-2c50ecfd6b86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]). {{(pid=82421) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Acquiring lock "cinder-quobyte-7feaa2d5-43f3-4764-9904-72350a5427f6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-quobyte-7feaa2d5-43f3-4764-9904-72350a5427f6" acquired by "delete_volume" :: waited 0.040s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3c8b32-ebe8-488b-bd6a-599770adec61]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:57 devstack sudo[86164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6
Apr 06 16:52:57 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 06 16:52:57 devstack cinder-volume[82421]: INFO cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Image download 20.69 MB at 20.69 MB/s
Apr 06 16:52:57 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d2cef4-e96f-404b-a7c2-47d08ee85f3f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc" returned: 0 in 0.631s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.792s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1566439936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe445b47-2374-41b0-906b-01790773707f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70f2420bb23e4958becf791b895efbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:56Z,use_quota=True,user_id='a53c923452dd45f191ac074e28b2fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Creating volume fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:52:57 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bf7b04-c1b8-420e-a38b-c1ea5c9fae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10bd10d-c6e5-46f9-88de-105a9d3884a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:57 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD
Apr 06 16:52:57 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:57 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f 1073741824
Apr 06 16:52:57 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:57 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Volume volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc (9167dc96-1e38-458a-bc55-3e45db0ccfcc): created successfully
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10bd10d-c6e5-46f9-88de-105a9d3884a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Flow 'volume_create_manager' (9a0f7198-0cf2-4d28-8105-a32e200e35f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:57 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-801cd228-c830-4625-9c91-e0a13a4ac524 tempest-SnapshotsActionsTest-404972137 None] Created volume successfully.
Apr 06 16:52:58 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6" returned: 0 in 0.591s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:58 devstack sudo[86175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6
Apr 06 16:52:58 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:58 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 is fetched for user c38c7aec45044a8896e8a23fa0cb1e60. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ada556-5be2-400e-9a9f-968d1f78630d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:58 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f 1073741824" returned: 0 in 0.595s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:58 devstack sudo[86183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD
Apr 06 16:52:58 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:58 devstack sudo[86184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:52:58 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:58 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feaa2d5-43f3-4764-9904-72350a5427f6" returned: 0 in 0.636s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-quobyte-7feaa2d5-43f3-4764-9904-72350a5427f6" released by "delete_volume" :: held 1.273s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Created reservations ['85731783-e879-4516-9c7e-706b5dbc99d7', '62bb7a4f-8a8b-4cd8-8542-9cb5b7c7a4a5', '1da36594-1a69-4600-b6a2-d937a031a116', '70ebf3cf-45e5-4200-bb34-ab88bcac2028'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:59 devstack sudo[86191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:52:59 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:59 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD" returned: 0 in 0.634s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:52:59 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.819s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.471s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e4e141-4c2c-4e08-ab8d-30d86487b602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe445b47-2374-41b0-906b-01790773707f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320a2e5d-d1ac-4e3b-b906-0ddb5075f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:52:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Volume volume-fe445b47-2374-41b0-906b-01790773707f (fe445b47-2374-41b0-906b-01790773707f): created successfully
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320a2e5d-d1ac-4e3b-b906-0ddb5075f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Flow 'volume_create_manager' (d27ee3b7-5a32-4773-a2c4-c9b6ef6b15c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Creating offline snapshot 5fac3925-0332-440e-972e-3e7aaf050625 of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:52:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5190affb-31f9-4311-a029-18642d54f0aa tempest-VolumesDeleteCascade-336542626 None] Created volume successfully.
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e9595-590e-4e73-8417-57a420d8cdb3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:59 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.502s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:52:59 devstack sudo[86196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc
Apr 06 16:52:59 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:52:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Deleted volume successfully.
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0956cd20-575f-41f7-8861-009ba6a2354a tempest-VolumesTransfersV357Test-47571065 None] Lock "cinder-7feaa2d5-43f3-4764-9904-72350a5427f6-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:52:59 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:52:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:52:59 devstack sudo[86202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 1G
Apr 06 16:52:59 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:00 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 1G" returned: 0 in 0.621s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:00 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:00 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:00 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:00 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 is being set with open permissions: ugo+rw
Apr 06 16:53:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:00 devstack sudo[86215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:00 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:01 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.424s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:01 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info
Apr 06 16:53:01 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:02 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info" returned: 0 in 0.595s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:02 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info is being set with open permissions: ugo+rw
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:02 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info
Apr 06 16:53:02 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:02 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.info" returned: 0 in 0.504s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.206s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.474s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:52:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4e234d-e694-4f3e-9f2f-7eae3fcbc867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02a08bb19c0f4f04936c6f155914aba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:52:57Z,use_quota=True,user_id='c38c7aec45044a8896e8a23fa0cb1e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Creating volume 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:02 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:53:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:02 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 1073741824
Apr 06 16:53:02 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0b24d5d1-1f68-412b-aca6-ba3e8431055f tempest-SnapshotsActionsTest-404972137 None] Create snapshot completed successfully
Apr 06 16:53:03 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 1073741824" returned: 0 in 0.599s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:03 devstack sudo[86242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:03 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:03 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.170s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:03 devstack sudo[86245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:03 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Creating offline snapshot 700e7ce3-b387-420d-8b35-0ac6702d35e7 of volume fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[732a86d7-e14a-4e81-b0db-eed960848e13]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Attempting download of 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec91bad-8c56-4864-ac21-ed272ca7cd48]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:03 devstack sudo[86248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma
Apr 06 16:53:03 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:03 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:53:03 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:04 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.660s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:04 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.728s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:04 devstack sudo[86274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 1G
Apr 06 16:53:04 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:04 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma" returned: 0 in 0.759s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:04 devstack sudo[86276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma
Apr 06 16:53:04 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:04 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 1G" returned: 0 in 0.560s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:05 devstack sudo[86281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:05 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:05 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma" returned: 1 in 0.617s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_r55sajma' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc943524-f4a1-4198-bd8c-f502adb1dd93]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:05 devstack sudo[86285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD
Apr 06 16:53:05 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:05 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.515s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:05 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 is being set with open permissions: ugo+rw
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:05 devstack sudo[86290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:05 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:05 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD" returned: 0 in 0.620s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] 765549bd-5564-4279-accf-2c50ecfd6b86 was qcow2, converting to raw {{(pid=82421) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 06 16:53:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:05 devstack sudo[86295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:05 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:06 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.507s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:06 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info
Apr 06 16:53:06 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:06 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:06 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info is being set with open permissions: ugo+rw
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:06 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info
Apr 06 16:53:06 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:06 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 0 in 1.210s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_5sqhl3cfdevstack@QuobyteHD, size 112.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:53:06 devstack cinder-volume[82421]: INFO cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Converted 112.00 MB image at 92.38 MB/s
Apr 06 16:53:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:07 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 1G
Apr 06 16:53:07 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:07 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.info" returned: 0 in 0.794s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.675s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.714s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:07 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4977d3a4-d2fd-4874-bce5-ca71b58923d2 tempest-VolumesDeleteCascade-336542626 None] Create snapshot completed successfully
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Creating offline snapshot 83f45cc3-2fb7-44c2-b88a-037b34d1168a of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d626d54-40b0-423b-a124-d7839df41b78]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:07 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:07 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:07 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 1G" returned: 0 in 0.897s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa2ed5-4e1f-4034-b0c1-417120cd7e7a]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:08 devstack sudo[86325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:08 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:08 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.854s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:08 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a 1G
Apr 06 16:53:08 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:08 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 0 in 0.744s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:08 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:08 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:09 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a 1G" returned: 0 in 0.954s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:09 devstack sudo[86341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a
Apr 06 16:53:09 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:09 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 1 in 0.738s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Downloaded image 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 successfully. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 for user c38c7aec45044a8896e8a23fa0cb1e60 is deleted. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Marking volume 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 as bootable. {{(pid=82421) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Copying metadata from image 765549bd-5564-4279-accf-2c50ecfd6b86 to 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867. {{(pid=82421) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Creating volume glance metadata for volume 1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 backed by image 765549bd-5564-4279-accf-2c50ecfd6b86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82421) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c071169-2a2e-4c82-a1b7-ce4cb30105bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e1544e290>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d83dee-0ddd-47ba-913d-ee9f798db02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:09 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Volume volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 (1b4e234d-e694-4f3e-9f2f-7eae3fcbc867): created successfully
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d83dee-0ddd-47ba-913d-ee9f798db02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Flow 'volume_create_manager' (cb4ba532-48ec-4ee1-aa2c-c571b6c42a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:09 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-eaca5733-b094-4af0-b381-003c22c2b8cf tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Created volume successfully.
Apr 06 16:53:10 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a" returned: 0 in 0.785s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:10 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a is being set with open permissions: ugo+rw
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:10 devstack sudo[86347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a
Apr 06 16:53:10 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:10 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a" returned: 0 in 0.520s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.185s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.309s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Creating offline snapshot d8f57dfa-85d8-4af2-9832-1ebc2645d399 of volume fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e250c4-188b-4d50-811b-dbf1a9259917]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-76822a02-7503-40b5-a51b-cd2ae5b0cd66 tempest-SnapshotsActionsTest-404972137 None] Create snapshot completed successfully
Apr 06 16:53:10 devstack sudo[86350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:10 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Flow 'volume_create_manager' (1d2f402e-6215-4602-a292-d859a2a979da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b60ef8-ee2f-4357-a340-02caa9674fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b60ef8-ee2f-4357-a340-02caa9674fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928674705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab92e2a-d6fa-4d66-9502-25577a600be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f340919824729a707570030135143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:11Z,use_quota=True,user_id='c507010a1b654576af2d5013e49a7198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049498fc-c1b1-40d2-aeb5-f7b56427f91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049498fc-c1b1-40d2-aeb5-f7b56427f91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698b1275-25de-4c0f-ab97-a5e281b47713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698b1275-25de-4c0f-ab97-a5e281b47713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab92e2a-d6fa-4d66-9502-25577a600be4', 'volume_name': 'volume-fab92e2a-d6fa-4d66-9502-25577a600be4', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7289bbe-de01-41f8-add3-301b1b377e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7289bbe-de01-41f8-add3-301b1b377e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651f8172-af38-4078-bbfd-4c6aa66b598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Volume fab92e2a-d6fa-4d66-9502-25577a600be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab92e2a-d6fa-4d66-9502-25577a600be4', 'volume_size': 1}
Apr 06 16:53:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-83f45cc3-2fb7-44c2-b88a-037b34d1168a-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-83f45cc3-2fb7-44c2-b88a-037b34d1168a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-83f45cc3-2fb7-44c2-b88a-037b34d1168a" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-83f45cc3-2fb7-44c2-b88a-037b34d1168a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:11 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Deleting offline snapshot 83f45cc3-2fb7-44c2-b88a-037b34d1168a of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] snapshot_file for this snap is: volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.593s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe445b47-2374-41b0-906b-01790773707f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dddb08-3dda-43ef-b2b4-ea8f94556122]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:11 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 1G
Apr 06 16:53:11 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:11 devstack sudo[86356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a
Apr 06 16:53:11 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:11 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf3976-7d87-4133-9597-feb1b26f345c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:11 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 1G" returned: 0 in 0.513s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:11 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399
Apr 06 16:53:11 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:11 devstack sudo[86365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:11 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:12 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:12 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 is being set with open permissions: ugo+rw
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:12 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:12 devstack sudo[86375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399
Apr 06 16:53:12 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:12 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a
Apr 06 16:53:12 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:12 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399" returned: 0 in 0.436s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928674705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab92e2a-d6fa-4d66-9502-25577a600be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05f340919824729a707570030135143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:11Z,use_quota=True,user_id='c507010a1b654576af2d5013e49a7198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Creating volume fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:12 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:12 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 1073741824
Apr 06 16:53:12 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3e9251a5-d52a-49fe-a1ca-3aaa3f8e27a7 tempest-VolumesDeleteCascade-336542626 None] Create snapshot completed successfully
Apr 06 16:53:12 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a" returned: 0 in 0.539s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:12 devstack sudo[86400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a
Apr 06 16:53:12 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:13 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 1073741824" returned: 0 in 0.489s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:13 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.83f45cc3-2fb7-44c2-b88a-037b34d1168a" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-83f45cc3-2fb7-44c2-b88a-037b34d1168a" released by "_delete_snapshot" :: held 1.984s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" released by "delete_snapshot" :: held 1.997s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:13 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:53:13 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Created reservations ['9f921001-77a5-4da4-a77b-7347811d990d', '2b605663-ffd0-4d45-9d86-7f1d02b3d575', 'b965c24d-733f-4dfa-83cf-33b125f9d48b', '58fd8602-a891-4733-930c-098b7488b425'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Delete snapshot completed successfully.
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-be1611b2-2d25-40b1-a0bc-4a15cac8b9b7 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-83f45cc3-2fb7-44c2-b88a-037b34d1168a-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-fe445b47-2374-41b0-906b-01790773707f-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-fe445b47-2374-41b0-906b-01790773707f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Performing cascade delete. {{(pid=82421) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-700e7ce3-b387-420d-8b35-0ac6702d35e7-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-700e7ce3-b387-420d-8b35-0ac6702d35e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-700e7ce3-b387-420d-8b35-0ac6702d35e7" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-700e7ce3-b387-420d-8b35-0ac6702d35e7" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Deleting offline snapshot 700e7ce3-b387-420d-8b35-0ac6702d35e7 of volume fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:13 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] snapshot_file for this snap is: volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.823s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2789618f-6275-4fb6-9bff-08e403c51c38]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651f8172-af38-4078-bbfd-4c6aa66b598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab92e2a-d6fa-4d66-9502-25577a600be4', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540c9b67-5a3e-487c-ad74-0bc4b1caec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Volume volume-fab92e2a-d6fa-4d66-9502-25577a600be4 (fab92e2a-d6fa-4d66-9502-25577a600be4): created successfully
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540c9b67-5a3e-487c-ad74-0bc4b1caec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Flow 'volume_create_manager' (1d2f402e-6215-4602-a292-d859a2a979da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eaa302-cd67-48db-b601-720febef9f3e]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f1ce2d6e-f827-43a0-963a-413ec3f89a54 tempest-VolumesActionsTest-324770953 None] Created volume successfully.
Apr 06 16:53:13 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:13 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:13 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:13 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:14 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe445b47-2374-41b0-906b-01790773707f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7a24b0-4dae-4e5e-a313-58af9d4627cd]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:14 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 0 in 0.497s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:14 devstack sudo[86425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:53:14 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:14 devstack sudo[86427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:14 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:14 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 1 in 0.572s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.114s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.071s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Creating offline snapshot 3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4974b3f-23bc-4feb-adee-a193d7433852]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:14 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.717s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240', 'name': 'volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58911d9e-1a1f-490d-8e1c-f5551ccc22cc', 'enforce_multipath': True} {{(pid=82421) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7e2f0-559e-4a6e-a2fd-277cb384895f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:14 devstack sudo[86445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:14 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-3d605a09-30c1-4517-8b68-825a329e85ea req-12e8511b-e2ca-4d49-a1fc-3d46505e5d0a tempest-ServerBootFromVolumeStableRescueTest-304154173 None] attachment_update completed successfully.
Apr 06 16:53:14 devstack sudo[86447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399
Apr 06 16:53:14 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:15 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:15 devstack sudo[86453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 1G
Apr 06 16:53:15 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:15 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399" returned: 0 in 0.565s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe445b47-2374-41b0-906b-01790773707f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[572273e5-a552-4113-855c-be8b042ea8c6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:15 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:15 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:15 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 1G" returned: 0 in 0.565s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:15 devstack sudo[86466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67
Apr 06 16:53:15 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:15 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe445b47-2374-41b0-906b-01790773707f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[07982be9-5399-4cf5-9b84-e131101a3fc0]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:15 devstack sudo[86468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:53:15 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:16 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" returned: 0 in 0.562s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:16 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 is being set with open permissions: ugo+rw
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:16 devstack sudo[86476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67
Apr 06 16:53:16 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:16 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.546s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:16 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:16 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:16 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:16 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d1775d1b-d671-4aed-b9bf-c0808eb73e18 tempest-SnapshotsActionsTest-404972137 None] Create snapshot completed successfully
Apr 06 16:53:16 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.544s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:16 devstack sudo[86484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7
Apr 06 16:53:16 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:17 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.700e7ce3-b387-420d-8b35-0ac6702d35e7" returned: 0 in 0.412s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 -F qcow2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:17 devstack sudo[86487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 -F qcow2
Apr 06 16:53:17 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:17 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe445b47-2374-41b0-906b-01790773707f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 -F qcow2" returned: 0 in 0.445s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-700e7ce3-b387-420d-8b35-0ac6702d35e7" released by "_delete_snapshot" :: held 4.306s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" released by "delete_snapshot" :: held 4.317s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Deleting offline snapshot 3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] snapshot_file for this snap is: volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3304dbf-ec45-489e-bf15-07ca84c846a7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:17 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Created reservations ['99089d61-6670-47f3-90d1-a10cf0430c57', 'b69f2758-6de0-476c-a9d7-b88d8ea30267', 'ea4adc7c-4fb9-4438-b919-bbe06441c88d', '71f5e7ef-712b-4475-97bb-1a1d89d18a96'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Delete snapshot completed successfully.
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-700e7ce3-b387-420d-8b35-0ac6702d35e7-delete_snapshot" released by "delete_snapshot" :: held 4.506s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-d8f57dfa-85d8-4af2-9832-1ebc2645d399-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:18 devstack sudo[86495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67
Apr 06 16:53:18 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-d8f57dfa-85d8-4af2-9832-1ebc2645d399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-d8f57dfa-85d8-4af2-9832-1ebc2645d399" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-d8f57dfa-85d8-4af2-9832-1ebc2645d399" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Deleting offline snapshot d8f57dfa-85d8-4af2-9832-1ebc2645d399 of volume fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] snapshot_file for this snap is: volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b72692-52ea-4bae-beca-ac428c9f2444]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:18 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399
Apr 06 16:53:18 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:18 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" returned: 0 in 0.508s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b533af67-3cd0-42f8-8bb0-e4740126b887]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:18 devstack sudo[86504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:18 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:18 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399" returned: 0 in 0.504s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe445b47-2374-41b0-906b-01790773707f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae74367-d93c-4319-9862-b1f05b276856]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:18 devstack sudo[86507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:53:18 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:18 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.527s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:19 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67
Apr 06 16:53:19 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:19 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.519s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:19 devstack sudo[86551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399
Apr 06 16:53:19 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:19 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" returned: 0 in 0.569s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:19 devstack sudo[86576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67
Apr 06 16:53:19 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:19 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399" returned: 0 in 0.570s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:19 devstack sudo[86584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399
Apr 06 16:53:19 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:20 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f.d8f57dfa-85d8-4af2-9832-1ebc2645d399" returned: 0 in 0.609s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-d8f57dfa-85d8-4af2-9832-1ebc2645d399" released by "_delete_snapshot" :: held 2.262s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" released by "delete_snapshot" :: held 2.290s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Created reservations ['6bd6a044-6e5a-42f9-9cde-1eb3e20d004a', '1f3a489b-8b99-42fb-887e-e6488a255d73', 'd4bb6792-c6b2-499a-8d50-4ecfc1931007', 'a4c4113d-7782-4cd9-9bd8-09be805388b2'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:20 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" returned: 0 in 0.895s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:20 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Delete snapshot completed successfully.
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-d8f57dfa-85d8-4af2-9832-1ebc2645d399-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Snapshots deleted, issuing volume delete {{(pid=82421) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67" released by "_delete_snapshot" :: held 2.579s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" released by "delete_snapshot" :: held 2.596s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" acquired by "delete_volume" :: waited 0.021s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ddf5ed-f077-472b-9922-857791407c1e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Created reservations ['c7f834d2-9a39-4c73-b1e3-004c49739636', '68d9365b-fbd2-4c4d-a377-e270fafe8ba2', 'ba2211b5-c81e-4e73-b8b8-9bd5145116cf', 'f067c414-c792-41d3-a5b4-f26281907445'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:20 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:53:20 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:20 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Delete snapshot completed successfully.
Apr 06 16:53:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b2b1d4c7-657c-4ca3-863e-c007475b9f8c tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-3d3f0111-4f7c-46f8-a0f0-9e858bd2ac67-delete_snapshot" released by "delete_snapshot" :: held 2.830s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:UPDATE=207,cinder:SELECT=166,cinder:DELETE=23,cinder:INSERT=48 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:53:21 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=162,cinder:UPDATE=211,cinder:DELETE=15,cinder:INSERT=61 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.904s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Creating offline snapshot 8e9e42b7-c40e-496c-9496-5c780460bdda of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:21 devstack sudo[86598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f
Apr 06 16:53:21 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5bbaf9-d88d-4dd9-b5f4-bb5e17d71f51]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:21 devstack sudo[86600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:21 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:22 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fe445b47-2374-41b0-906b-01790773707f" returned: 0 in 0.600s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-fe445b47-2374-41b0-906b-01790773707f" released by "delete_volume" :: held 1.561s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Created reservations ['d01c5d86-925f-4400-bd7f-e6354ada6f82', '55fe585d-c470-4936-84a5-c6d80f8da771', 'd80e04bc-509c-4fc0-b0f5-9041995b72bd', '1fa9a4be-4c66-497c-a7e8-d0dc3245d7bf'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:22 devstack sudo[86610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:22 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:22 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.809s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:22 devstack sudo[86621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda 1G
Apr 06 16:53:22 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:22 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.499s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Deleted volume successfully.
Apr 06 16:53:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-21f7e0f4-16ad-4fe8-8aab-145df474b7d6 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-fe445b47-2374-41b0-906b-01790773707f-delete_volume" released by "delete_volume" :: held 9.287s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:23 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda 1G" returned: 0 in 0.668s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:23 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda
Apr 06 16:53:23 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:23 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda" returned: 0 in 0.547s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:23 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda is being set with open permissions: ugo+rw
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:23 devstack sudo[86639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda
Apr 06 16:53:23 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Flow 'volume_create_manager' (43a9d9e7-9c01-41d4-8a70-1c9fd8a9ed03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb02cd9-bfef-45cf-8699-d9465fce52b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb02cd9-bfef-45cf-8699-d9465fce52b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1600808181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30527f6-c63f-432e-b741-f2cdaf5689d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70f2420bb23e4958becf791b895efbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:24Z,use_quota=True,user_id='a53c923452dd45f191ac074e28b2fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9430578e-6df1-4de4-8928-445bab986226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9430578e-6df1-4de4-8928-445bab986226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fcda55-6bd4-4a0d-b9d7-720296b60904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31fcda55-6bd4-4a0d-b9d7-720296b60904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30527f6-c63f-432e-b741-f2cdaf5689d8', 'volume_name': 'volume-a30527f6-c63f-432e-b741-f2cdaf5689d8', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252e1f25-58c4-4583-bfb3-9d175d3a8e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252e1f25-58c4-4583-bfb3-9d175d3a8e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fdf08d-69b9-4961-b91b-0c155ed14081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Volume a30527f6-c63f-432e-b741-f2cdaf5689d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30527f6-c63f-432e-b741-f2cdaf5689d8', 'volume_size': 1}
Apr 06 16:53:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:24 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1600808181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30527f6-c63f-432e-b741-f2cdaf5689d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70f2420bb23e4958becf791b895efbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:24Z,use_quota=True,user_id='a53c923452dd45f191ac074e28b2fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Creating volume a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:24 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:24 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 1073741824
Apr 06 16:53:24 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-830ee7e4-66ee-4f47-9e63-b72e4e4f1969 tempest-SnapshotsActionsTest-404972137 None] Create snapshot completed successfully
Apr 06 16:53:24 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 1073741824" returned: 0 in 0.582s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-8e9e42b7-c40e-496c-9496-5c780460bdda-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-8e9e42b7-c40e-496c-9496-5c780460bdda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:24 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:24 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-8e9e42b7-c40e-496c-9496-5c780460bdda" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-8e9e42b7-c40e-496c-9496-5c780460bdda" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Deleting offline snapshot 8e9e42b7-c40e-496c-9496-5c780460bdda of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] snapshot_file for this snap is: volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18ffcc1-9d8f-4059-8207-4621a60fead8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:25 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda
Apr 06 16:53:25 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:25 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.501s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fdf08d-69b9-4961-b91b-0c155ed14081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30527f6-c63f-432e-b741-f2cdaf5689d8', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2c81b1-2d43-4cf6-90f6-cc08c8d00008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Volume volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 (a30527f6-c63f-432e-b741-f2cdaf5689d8): created successfully
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2c81b1-2d43-4cf6-90f6-cc08c8d00008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Flow 'volume_create_manager' (43a9d9e7-9c01-41d4-8a70-1c9fd8a9ed03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8b186b7c-ed7b-4332-a616-1db7048a75d0 tempest-VolumesDeleteCascade-336542626 None] Created volume successfully.
Apr 06 16:53:25 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda" returned: 0 in 0.548s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b7ecc6-7921-472b-9da9-80fb1b4ec6ab]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:25 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:25 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:25 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.531s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:25 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda
Apr 06 16:53:25 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Creating offline snapshot 8df5f931-66d6-4b33-ae31-a12bc02f0721 of volume a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c716bbf-cb08-4533-9895-f2132c68f0f8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:26 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:26 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:26 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:26 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda
Apr 06 16:53:26 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:26 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:26 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 1G
Apr 06 16:53:26 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:26 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.8e9e42b7-c40e-496c-9496-5c780460bdda" returned: 0 in 0.447s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-8e9e42b7-c40e-496c-9496-5c780460bdda" released by "_delete_snapshot" :: held 2.118s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" released by "delete_snapshot" :: held 2.130s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Created reservations ['74293cf9-50b5-4ba9-ba82-e6a7e2bb7c17', '80a14acb-d2d0-4434-b856-3f5e9d678154', 'b6197881-0158-4d33-8b03-241adab5719e', 'eaf4463f-7f10-4ae2-824c-443412868fbd'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Delete snapshot completed successfully.
Apr 06 16:53:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-81dd3e97-4eb7-4052-92d3-3865932a3759 tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-8e9e42b7-c40e-496c-9496-5c780460bdda-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:27 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 1G" returned: 0 in 0.746s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:27 devstack sudo[86730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721
Apr 06 16:53:27 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:28 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721" returned: 0 in 0.730s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:28 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 is being set with open permissions: ugo+rw
Apr 06 16:53:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:28 devstack sudo[86740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721
Apr 06 16:53:28 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:28 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721" returned: 0 in 0.458s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:28 devstack sudo[86743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info
Apr 06 16:53:28 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:29 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:29 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info is being set with open permissions: ugo+rw
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:29 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info
Apr 06 16:53:29 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e4701841-1b53-4429-8fc8-ce5fcf3c18fd tempest-VolumesActionsTest-324770953 None] Acquiring lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4" by "attach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e4701841-1b53-4429-8fc8-ce5fcf3c18fd tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4" acquired by "attach_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e4701841-1b53-4429-8fc8-ce5fcf3c18fd tempest-VolumesActionsTest-324770953 None] Attaching volume fab92e2a-d6fa-4d66-9502-25577a600be4 to instance 0b82defb-8cd7-4ac7-a8d2-f99694b8d300 at mountpoint /dev/vdb on host None.
Apr 06 16:53:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e4701841-1b53-4429-8fc8-ce5fcf3c18fd tempest-VolumesActionsTest-324770953 None] Attach volume completed successfully.
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e4701841-1b53-4429-8fc8-ce5fcf3c18fd tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4" released by "attach_volume" :: held 0.065s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:29 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.info" returned: 0 in 0.495s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.502s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.366s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Creating offline snapshot 9a1293c3-6151-4cfc-a2d2-4844a80edc5c of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:53:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-53738594-af9a-4740-8bd3-68a25afc165a tempest-VolumesDeleteCascade-336542626 None] Create snapshot completed successfully
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f17c44-e3aa-48a1-ad36-7fd986d40435]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:29 devstack sudo[86775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:29 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9923749c-7b05-4e51-9ae1-16c26c41bb8f tempest-VolumesActionsTest-324770953 None] Acquiring lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-detach_volume" by "detach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9923749c-7b05-4e51-9ae1-16c26c41bb8f tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9923749c-7b05-4e51-9ae1-16c26c41bb8f tempest-VolumesActionsTest-324770953 None] Detaching volume fab92e2a-d6fa-4d66-9502-25577a600be4 from instance 0b82defb-8cd7-4ac7-a8d2-f99694b8d300.
Apr 06 16:53:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9923749c-7b05-4e51-9ae1-16c26c41bb8f tempest-VolumesActionsTest-324770953 None] Detach volume completed successfully.
Apr 06 16:53:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9923749c-7b05-4e51-9ae1-16c26c41bb8f tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:30 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.489s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:30 devstack sudo[86780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c 1G
Apr 06 16:53:30 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:30 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c 1G" returned: 0 in 0.534s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:30 devstack sudo[86785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c
Apr 06 16:53:30 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Flow 'volume_create_manager' (fe1e2a26-2881-48a7-853a-89a47475b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413a9fff-da1e-42a7-8907-acc6a688e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413a9fff-da1e-42a7-8907-acc6a688e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1638956405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d875c65-74f9-43f2-8543-1f10cca63535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70f2420bb23e4958becf791b895efbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8df5f931-66d6-4b33-ae31-a12bc02f0721,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:31Z,use_quota=True,user_id='a53c923452dd45f191ac074e28b2fd55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abbb424-9428-4f7e-9208-67ccd02c94d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abbb424-9428-4f7e-9208-67ccd02c94d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8c698b-6319-4107-b262-c0fd14dd07e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8c698b-6319-4107-b262-c0fd14dd07e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d875c65-74f9-43f2-8543-1f10cca63535', 'volume_name': 'volume-2d875c65-74f9-43f2-8543-1f10cca63535', 'volume_size': 1, 'snapshot_id': '8df5f931-66d6-4b33-ae31-a12bc02f0721'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177657f4-cbc8-45a0-9478-e7368a11525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177657f4-cbc8-45a0-9478-e7368a11525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8faede07-245b-480f-9fec-f7bc466cfee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:30 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Volume 2d875c65-74f9-43f2-8543-1f10cca63535: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d875c65-74f9-43f2-8543-1f10cca63535', 'volume_size': 1, 'snapshot_id': '8df5f931-66d6-4b33-ae31-a12bc02f0721'}
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:30 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:30 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c is being set with open permissions: ugo+rw
Apr 06 16:53:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:31 devstack sudo[86791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c
Apr 06 16:53:31 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:31 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.601s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-8df5f931-66d6-4b33-ae31-a12bc02f0721-2d875c65-74f9-43f2-8543-1f10cca63535" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-8df5f931-66d6-4b33-ae31-a12bc02f0721-2d875c65-74f9-43f2-8543-1f10cca63535" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Creating volume 2d875c65-74f9-43f2-8543-1f10cca63535 from snapshot 8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-2d875c65-74f9-43f2-8543-1f10cca63535" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-2d875c65-74f9-43f2-8543-1f10cca63535" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] snapshot: 8df5f931-66d6-4b33-ae31-a12bc02f0721, volume: 2d875c65-74f9-43f2-8543-1f10cca63535,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:53:31 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-34af3a0d-4c3c-4ade-a24d-632b6ea1cbf3 tempest-SnapshotsActionsTest-404972137 None] Create snapshot completed successfully
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743ff0e-2d53-4681-a9ab-938ea0370fbe]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:31 devstack sudo[86794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721
Apr 06 16:53:31 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:32 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721" returned: 0 in 0.578s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30527f6-c63f-432e-b741-f2cdaf5689d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a3d763-1041-4712-91bd-398be6b05056]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:32 devstack sudo[86832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:32 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:32 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-9a1293c3-6151-4cfc-a2d2-4844a80edc5c-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.495s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-9a1293c3-6151-4cfc-a2d2-4844a80edc5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Acquiring lock "cinder-quobyte-9a1293c3-6151-4cfc-a2d2-4844a80edc5c" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:32 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535
Apr 06 16:53:32 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9a1293c3-6151-4cfc-a2d2-4844a80edc5c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Deleting offline snapshot 9a1293c3-6151-4cfc-a2d2-4844a80edc5c of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] snapshot_file for this snap is: volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5adc39-637c-498a-9795-c2b0efeb44e1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:32 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c
Apr 06 16:53:32 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:33 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c" returned: 0 in 0.732s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b2de86-7904-4999-95a2-51f67a338c48]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:33 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:33 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:35 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 1.582s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:35 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c
Apr 06 16:53:35 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:36 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535" returned: 0 in 3.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf19878-3f22-4d23-99a6-3e3dc6a32eef]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:36 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c" returned: 0 in 1.020s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:36 devstack sudo[86899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c
Apr 06 16:53:36 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:36 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:36 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:36 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.9a1293c3-6151-4cfc-a2d2-4844a80edc5c" returned: 0 in 0.502s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9a1293c3-6151-4cfc-a2d2-4844a80edc5c" released by "_delete_snapshot" :: held 3.970s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" released by "delete_snapshot" :: held 3.988s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Created reservations ['209c5113-4ba2-418a-80a1-0a10fc43f092', '08ec2c6a-bdb7-46f1-b64d-01a4d1c4edbb', '5b9e2c5f-0d1d-4592-a28a-91a8d4c56ca7', 'd399a9fa-f9b6-4496-b534-401e95ef62a3'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Delete snapshot completed successfully.
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-201ef12a-e4bb-47d5-9ce8-ee3df29d271b tempest-SnapshotsActionsTest-278302299 None] Lock "cinder-9a1293c3-6151-4cfc-a2d2-4844a80edc5c-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:36 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.684s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8, size 1024.00 MB, duration 3.48 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:53:36 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Converted 1024.00 MB image at 294.56 MB/s
Apr 06 16:53:36 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 is being set with open permissions: ugo+rw
Apr 06 16:53:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:36 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535
Apr 06 16:53:36 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:37 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535" returned: 0 in 0.421s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-2d875c65-74f9-43f2-8543-1f10cca63535" released by "_copy_volume_from_snapshot" :: held 5.763s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-8df5f931-66d6-4b33-ae31-a12bc02f0721-2d875c65-74f9-43f2-8543-1f10cca63535" released by "_create_volume_from_snapshot" :: held 5.783s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.810s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8faede07-245b-480f-9fec-f7bc466cfee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d875c65-74f9-43f2-8543-1f10cca63535', 'volume_size': 1, 'snapshot_id': '8df5f931-66d6-4b33-ae31-a12bc02f0721'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d77f287-0525-4c7d-aa10-2968a8eb3c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:37 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Volume volume-2d875c65-74f9-43f2-8543-1f10cca63535 (2d875c65-74f9-43f2-8543-1f10cca63535): created successfully
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d77f287-0525-4c7d-aa10-2968a8eb3c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Flow 'volume_create_manager' (fe1e2a26-2881-48a7-853a-89a47475b17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "cinder-5fac3925-0332-440e-972e-3e7aaf050625-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:37 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fca523e6-757a-4617-9d5e-da63d1cac090 tempest-VolumesDeleteCascade-336542626 None] Created volume successfully.
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-5fac3925-0332-440e-972e-3e7aaf050625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "cinder-quobyte-5fac3925-0332-440e-972e-3e7aaf050625" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-quobyte-5fac3925-0332-440e-972e-3e7aaf050625" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Deleting offline snapshot 5fac3925-0332-440e-972e-3e7aaf050625 of volume 9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] snapshot_file for this snap is: volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56152ab-ceb3-45ae-8eec-4c16fb6c146c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:37 devstack sudo[86910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:37 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:37 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.546s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb48c30-7439-4aa9-a670-0c6284f31987]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:37 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc
Apr 06 16:53:37 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:38 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:38 devstack sudo[86920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:38 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-a30527f6-c63f-432e-b741-f2cdaf5689d8-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-a30527f6-c63f-432e-b741-f2cdaf5689d8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Performing cascade delete. {{(pid=82421) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-8df5f931-66d6-4b33-ae31-a12bc02f0721-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-8df5f931-66d6-4b33-ae31-a12bc02f0721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-a30527f6-c63f-432e-b741-f2cdaf5689d8" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-a30527f6-c63f-432e-b741-f2cdaf5689d8" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-8df5f931-66d6-4b33-ae31-a12bc02f0721" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-8df5f931-66d6-4b33-ae31-a12bc02f0721" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Deleting offline snapshot 8df5f931-66d6-4b33-ae31-a12bc02f0721 of volume a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] snapshot_file for this snap is: volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26b8bb-ed73-4c26-8ca4-5d0cdea5b363]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:38 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721
Apr 06 16:53:38 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:38 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:38 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625
Apr 06 16:53:38 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:39 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721" returned: 0 in 0.724s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30527f6-c63f-432e-b741-f2cdaf5689d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8adc0d9-aff1-4872-b7eb-fa8e23c0e7a2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:39 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:39 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:39 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc.5fac3925-0332-440e-972e-3e7aaf050625" returned: 0 in 0.571s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-quobyte-5fac3925-0332-440e-972e-3e7aaf050625" released by "_delete_snapshot" :: held 2.164s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" released by "delete_snapshot" :: held 2.179s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Created reservations ['787ce192-3acd-4e5c-b19e-bbdc697548bd', 'adbe46d3-f9f7-49c1-a7fb-735f4bd7bc46', '34105f8f-4dd3-475b-8479-a8d4a57068a6', '341ee40e-7645-4ef2-9b08-92a949cb25d6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Delete snapshot completed successfully.
Apr 06 16:53:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-913920ce-4d83-45fc-8e57-9a335cabd448 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-5fac3925-0332-440e-972e-3e7aaf050625-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:40 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.731s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:40 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721
Apr 06 16:53:40 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "cinder-9167dc96-1e38-458a-bc55-3e45db0ccfcc-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-9167dc96-1e38-458a-bc55-3e45db0ccfcc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" acquired by "delete_volume" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f0a494-bdba-4ab5-a8cd-81632c5f0522]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:40 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc
Apr 06 16:53:40 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:40 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721" returned: 0 in 0.696s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:40 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721
Apr 06 16:53:40 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:41 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc" returned: 0 in 0.574s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:41 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8.8df5f931-66d6-4b33-ae31-a12bc02f0721" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:41 devstack sudo[87002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc
Apr 06 16:53:41 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-8df5f931-66d6-4b33-ae31-a12bc02f0721" released by "_delete_snapshot" :: held 2.736s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-a30527f6-c63f-432e-b741-f2cdaf5689d8" released by "delete_snapshot" :: held 2.748s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Created reservations ['0076c508-6a07-4f4f-b6c9-2b0df7d832f3', '5ec9183a-bb5b-4e52-acaa-e8ba85d4e039', '41c5b4df-6842-4b56-9e4d-b6462181f875', '9e3e8a82-d36e-4ae2-aa62-67a7dbc7129b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:41 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Delete snapshot completed successfully.
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-8df5f931-66d6-4b33-ae31-a12bc02f0721-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Snapshots deleted, issuing volume delete {{(pid=82421) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-a30527f6-c63f-432e-b741-f2cdaf5689d8" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-a30527f6-c63f-432e-b741-f2cdaf5689d8" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ebd161-fde0-46d9-9bdf-55cf0a4d4d67]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:41 devstack sudo[87004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:41 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:41 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-9167dc96-1e38-458a-bc55-3e45db0ccfcc" returned: 0 in 0.748s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-quobyte-9167dc96-1e38-458a-bc55-3e45db0ccfcc" released by "delete_volume" :: held 1.401s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Created reservations ['bb5fda54-d5aa-4d9b-a8d2-090b4556110d', '71a5a620-d9b4-4d28-9369-9eded66919ea', '25d52250-8517-40a6-94ed-63e49cf57cf8', '1f9b8580-0d59-4e32-8196-97541bf32487'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:42 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:42 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:42 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.718s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:42 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8
Apr 06 16:53:42 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:42 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Deleted volume successfully.
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8bd62688-1069-4600-aaf7-87bcf03ce957 tempest-SnapshotsActionsTest-404972137 None] Lock "cinder-9167dc96-1e38-458a-bc55-3e45db0ccfcc-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:42 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a30527f6-c63f-432e-b741-f2cdaf5689d8" returned: 0 in 0.464s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-a30527f6-c63f-432e-b741-f2cdaf5689d8" released by "delete_volume" :: held 1.218s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Created reservations ['b842141b-6700-4d67-acbd-61bf67928a63', '0e5cf085-bf73-4c49-a220-462a1f185828', 'e9e4e319-2cd4-4416-af2e-597b352ca1fb', 'e7aaa548-40ad-4674-926d-fd31a0f86b22'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:42 devstack sudo[87017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:42 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-2d875c65-74f9-43f2-8543-1f10cca63535-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-2d875c65-74f9-43f2-8543-1f10cca63535-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "cinder-quobyte-2d875c65-74f9-43f2-8543-1f10cca63535" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-2d875c65-74f9-43f2-8543-1f10cca63535" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d73db4b-c2a5-4cc0-990d-3ac5f5aca453]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:43 devstack sudo[87043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535
Apr 06 16:53:43 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:43 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.613s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:43 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Deleted volume successfully.
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65049e26-14db-4b19-9cf6-c191bb129133 tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-a30527f6-c63f-432e-b741-f2cdaf5689d8-delete_volume" released by "delete_volume" :: held 4.848s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:43 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535" returned: 0 in 0.630s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:43 devstack sudo[87051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535
Apr 06 16:53:43 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:44 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2d875c65-74f9-43f2-8543-1f10cca63535" returned: 0 in 0.568s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-quobyte-2d875c65-74f9-43f2-8543-1f10cca63535" released by "delete_volume" :: held 1.227s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Created reservations ['fe710167-5780-4b9e-8f77-d726a2da2ebb', '4b1a1fa6-770d-49fa-bcff-33c314569cfe', '7921301f-7dcd-404a-95b3-10d280cbe837', '34f3487e-d998-4cbd-b4bb-7b76044821f1'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:44 devstack sudo[87055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:44 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:45 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.564s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:45 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:45 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Deleted volume successfully.
Apr 06 16:53:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-65dcea08-cb27-471b-a8c0-7229bf3e4f2d tempest-VolumesDeleteCascade-336542626 None] Lock "cinder-2d875c65-74f9-43f2-8543-1f10cca63535-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:45 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-5f6d160c-f6c9-4d28-b41d-f3f1a12bfc7c tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Terminate volume connection completed successfully.
Apr 06 16:53:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-5f6d160c-f6c9-4d28-b41d-f3f1a12bfc7c tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Deleting attachment 58911d9e-1a1f-490d-8e1c-f5551ccc22cc. {{(pid=82421) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}}
Apr 06 16:53:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "cinder-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "cinder-quobyte-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-quobyte-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1010f00-217a-4e5c-908a-367ec8a36703]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:46 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:46 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:47 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 0 in 0.556s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:47 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:47 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Flow 'volume_create_manager' (c19c7b47-a699-4b52-9c36-367dc8481fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9323fcc6-bc3f-4b57-993a-c44585958225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9323fcc6-bc3f-4b57-993a-c44585958225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-99728340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26080409-09cc-4638-94dd-c25712c45209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f8acc3225d4b73be4f32b96319d027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:48Z,use_quota=True,user_id='b05dc797b5a6475596967924e95da08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450c6c21-e7a3-47d6-9db8-07029782286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450c6c21-e7a3-47d6-9db8-07029782286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37abe4db-7caf-4e03-8229-15344f36216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37abe4db-7caf-4e03-8229-15344f36216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26080409-09cc-4638-94dd-c25712c45209', 'volume_name': 'volume-26080409-09cc-4638-94dd-c25712c45209', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e448bcb-1625-4dcd-a200-e20cf2875226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e448bcb-1625-4dcd-a200-e20cf2875226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74c733d-33d4-460d-bf60-831097bc737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:47 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Volume 26080409-09cc-4638-94dd-c25712c45209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26080409-09cc-4638-94dd-c25712c45209', 'volume_size': 1}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-99728340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26080409-09cc-4638-94dd-c25712c45209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f8acc3225d4b73be4f32b96319d027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:48Z,use_quota=True,user_id='b05dc797b5a6475596967924e95da08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Creating volume 26080409-09cc-4638-94dd-c25712c45209 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:47 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:47 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209 1073741824
Apr 06 16:53:47 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:47 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 1 in 0.574s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:53:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:47 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867
Apr 06 16:53:47 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:48 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209 1073741824" returned: 0 in 0.591s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:48 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" returned: 0 in 0.571s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-quobyte-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867" released by "delete_volume" :: held 1.750s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:48 devstack sudo[87095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209
Apr 06 16:53:48 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.quota [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Created reservations ['7738287b-0d76-4bc5-ae88-1446711289f5', 'a78cf763-7e55-428a-9e1f-edc8dea2dcac', '8d816ae3-eab9-4922-bacc-7ab035d5ef1b', '82a0c5ab-3205-40ea-bf01-12d799c3d288'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:48 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:48 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:48 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74c733d-33d4-460d-bf60-831097bc737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26080409-09cc-4638-94dd-c25712c45209', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55803ec8-9f77-4521-a4a8-3d1e155c3d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:48 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Volume volume-26080409-09cc-4638-94dd-c25712c45209 (26080409-09cc-4638-94dd-c25712c45209): created successfully
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55803ec8-9f77-4521-a4a8-3d1e155c3d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Flow 'volume_create_manager' (c19c7b47-a699-4b52-9c36-367dc8481fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:48 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4c12d68c-8c8b-436c-aa32-7f5fac3cbcea tempest-VolumesMetadataTest-1282318215 None] Created volume successfully.
Apr 06 16:53:48 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.453s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.manager [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:48 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Deleted volume successfully.
Apr 06 16:53:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-a299452a-fa1c-40b1-99b8-09ab93f5fed7 req-ad6595f6-bc75-48c9-92d4-a436879c4604 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-1b4e234d-e694-4f3e-9f2f-7eae3fcbc867-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Acquiring lock "cinder-26080409-09cc-4638-94dd-c25712c45209-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Lock "cinder-26080409-09cc-4638-94dd-c25712c45209-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Acquiring lock "cinder-quobyte-26080409-09cc-4638-94dd-c25712c45209" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Lock "cinder-quobyte-26080409-09cc-4638-94dd-c25712c45209" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71e61d-1af8-47b9-a64d-bdcfe464d803]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:50 devstack sudo[87129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209
Apr 06 16:53:50 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:51 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209" returned: 0 in 0.699s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:51 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209
Apr 06 16:53:51 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:52 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-26080409-09cc-4638-94dd-c25712c45209" returned: 0 in 0.680s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Lock "cinder-quobyte-26080409-09cc-4638-94dd-c25712c45209" released by "delete_volume" :: held 1.415s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Created reservations ['832f4653-9690-4bcc-9b52-67e59189fd41', 'b8e8eeb8-10bb-4318-a45f-10c31d2c2df8', '956d2a6e-fa92-4179-9e1a-bbd22ccdb0c9', '667a955d-eca6-4111-aefb-9a4f943036e0'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:52 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:53:52 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:52 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.518s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:53:52 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Deleted volume successfully.
Apr 06 16:53:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-654f50bd-5618-4932-882d-ba491c44e26e tempest-VolumesMetadataTest-1282318215 None] Lock "cinder-26080409-09cc-4638-94dd-c25712c45209-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cccc6573-1713-4c2c-80a1-960112ec802b tempest-VolumesActionsTest-324770953 None] Acquiring lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4" by "attach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cccc6573-1713-4c2c-80a1-960112ec802b tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4" acquired by "attach_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cccc6573-1713-4c2c-80a1-960112ec802b tempest-VolumesActionsTest-324770953 None] Attaching volume fab92e2a-d6fa-4d66-9502-25577a600be4 to instance aa1fed78-f4b8-42bc-95f8-5d8e04bc1c5d at mountpoint /dev/vdb on host None.
Apr 06 16:53:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cccc6573-1713-4c2c-80a1-960112ec802b tempest-VolumesActionsTest-324770953 None] Attach volume completed successfully.
Apr 06 16:53:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cccc6573-1713-4c2c-80a1-960112ec802b tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4" released by "attach_volume" :: held 0.070s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0aa908a5-7cd7-48f2-a89a-91c434e4e13c tempest-VolumesActionsTest-324770953 None] Acquiring lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-detach_volume" by "detach_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0aa908a5-7cd7-48f2-a89a-91c434e4e13c tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:54 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0aa908a5-7cd7-48f2-a89a-91c434e4e13c tempest-VolumesActionsTest-324770953 None] Detaching volume fab92e2a-d6fa-4d66-9502-25577a600be4 from instance aa1fed78-f4b8-42bc-95f8-5d8e04bc1c5d.
Apr 06 16:53:54 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0aa908a5-7cd7-48f2-a89a-91c434e4e13c tempest-VolumesActionsTest-324770953 None] Detach volume completed successfully.
Apr 06 16:53:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0aa908a5-7cd7-48f2-a89a-91c434e4e13c tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Flow 'volume_create_manager' (bc142758-dbb7-48d8-b7c7-000543c99b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03069403-ffec-46b8-a384-00a2dd9354b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03069403-ffec-46b8-a384-00a2dd9354b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-486120330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd52c5a6-3dff-4565-87d2-2cbf8bdaf869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37beabc37c1f42468913c56cec78c1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:56Z,use_quota=True,user_id='d988a957a8f3490a878299261ee15492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b567eae3-9fd5-4ed5-a537-f41ab814d3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b567eae3-9fd5-4ed5-a537-f41ab814d3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1b1b5b-9c9b-4108-be23-100274f69a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1b1b5b-9c9b-4108-be23-100274f69a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd52c5a6-3dff-4565-87d2-2cbf8bdaf869', 'volume_name': 'volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9a809a-5759-486e-ba4e-727b37731f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9a809a-5759-486e-ba4e-727b37731f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3905ac43-9730-47df-8576-dee9ed1e3010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:56 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Volume dd52c5a6-3dff-4565-87d2-2cbf8bdaf869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869', 'volume_size': 1}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-486120330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd52c5a6-3dff-4565-87d2-2cbf8bdaf869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37beabc37c1f42468913c56cec78c1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:56Z,use_quota=True,user_id='d988a957a8f3490a878299261ee15492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Creating volume dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:56 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:53:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:56 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 1073741824
Apr 06 16:53:56 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:57 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 1073741824" returned: 0 in 0.622s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:57 devstack sudo[87201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869
Apr 06 16:53:57 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:57 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3905ac43-9730-47df-8576-dee9ed1e3010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9feae8-452d-47d2-9397-fcb10da8e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:57 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Volume volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 (dd52c5a6-3dff-4565-87d2-2cbf8bdaf869): created successfully
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9feae8-452d-47d2-9397-fcb10da8e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Flow 'volume_create_manager' (bc142758-dbb7-48d8-b7c7-000543c99b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:57 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-42b0ae0c-3f51-464d-8f95-e70e252f5290 tempest-VolumesTransfersTest-1155668289 None] Created volume successfully.
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Flow 'volume_create_manager' (df632ab8-31b2-4e0d-9c8f-d1f26fcde8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7b1e71-b626-49a8-a4bd-0581c00a28e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7b1e71-b626-49a8-a4bd-0581c00a28e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1928491412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0433944f-81b1-4046-a74c-4fa46490db05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560e3afb20394ca8b42c5c515ee065d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:59Z,use_quota=True,user_id='be483d05f6614d5e863ed82c723818f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fa8e3c-e05b-4188-a2b5-df942a2761ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fa8e3c-e05b-4188-a2b5-df942a2761ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e5bf38-1ec7-4119-9700-ff50f26b5c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e5bf38-1ec7-4119-9700-ff50f26b5c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0433944f-81b1-4046-a74c-4fa46490db05', 'volume_name': 'volume-0433944f-81b1-4046-a74c-4fa46490db05', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505e6864-d0bc-48cd-b847-d65c919962d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505e6864-d0bc-48cd-b847-d65c919962d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4bdcba-c295-4761-86e5-5eebabcc8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:53:58 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Volume 0433944f-81b1-4046-a74c-4fa46490db05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0433944f-81b1-4046-a74c-4fa46490db05', 'volume_size': 1}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1928491412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0433944f-81b1-4046-a74c-4fa46490db05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560e3afb20394ca8b42c5c515ee065d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:53:59Z,use_quota=True,user_id='be483d05f6614d5e863ed82c723818f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Creating volume 0433944f-81b1-4046-a74c-4fa46490db05 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:53:58 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:53:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:58 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05 1073741824
Apr 06 16:53:58 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d7bd0e29-73b0-4ca0-8389-81126f89430f tempest-VolumesTransfersTest-689816831 None] Transfer volume completed successfully.
Apr 06 16:53:59 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05 1073741824" returned: 0 in 0.584s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:53:59 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05
Apr 06 16:53:59 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Acquiring lock "cinder-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Acquiring lock "cinder-quobyte-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-quobyte-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869" acquired by "delete_volume" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5fb237-3b0a-4b44-9643-30a8f9072419]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:53:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:00 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869
Apr 06 16:54:00 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:00 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05" returned: 0 in 0.505s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4bdcba-c295-4761-86e5-5eebabcc8471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0433944f-81b1-4046-a74c-4fa46490db05', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988b9744-dd8c-47fe-b869-47326dd8f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:00 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Volume volume-0433944f-81b1-4046-a74c-4fa46490db05 (0433944f-81b1-4046-a74c-4fa46490db05): created successfully
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988b9744-dd8c-47fe-b869-47326dd8f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Flow 'volume_create_manager' (df632ab8-31b2-4e0d-9c8f-d1f26fcde8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c51e5e13-953a-4e38-8ba4-15a046f91218 tempest-VolumeQuotasAdminTestJSON-202360159 None] Created volume successfully.
Apr 06 16:54:00 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869" returned: 0 in 0.509s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-43dfca1b-5b09-4262-87b4-4c46b6503e99 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Terminate volume connection completed successfully.
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-43dfca1b-5b09-4262-87b4-4c46b6503e99 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Deleting attachment 49aac38b-e0a2-4adc-a138-56c68413a660. {{(pid=82421) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}}
Apr 06 16:54:00 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869
Apr 06 16:54:00 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:00 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-quobyte-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869" released by "delete_volume" :: held 0.931s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Created reservations ['bb35f85c-07dd-4063-a0dc-7a2963f92553', '04acc908-90cf-4e85-bc69-f2638ebbe091', '8971f20c-7308-4073-92d7-0223953584c2', 'f2b8021e-9338-4e61-a964-509164804681'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:00 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:00 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "cinder-f4bcd35b-8895-4ba6-8ec9-912aae447025-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-f4bcd35b-8895-4ba6-8ec9-912aae447025-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "cinder-quobyte-f4bcd35b-8895-4ba6-8ec9-912aae447025" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-quobyte-f4bcd35b-8895-4ba6-8ec9-912aae447025" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "cinder-0433944f-81b1-4046-a74c-4fa46490db05-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[daad8c4c-a5a9-4c96-b661-5b0681375ee1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "cinder-0433944f-81b1-4046-a74c-4fa46490db05-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "cinder-quobyte-0433944f-81b1-4046-a74c-4fa46490db05" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "cinder-quobyte-0433944f-81b1-4046-a74c-4fa46490db05" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0f719e-2952-4429-a72f-48a8bedd76cc]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:01 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025
Apr 06 16:54:01 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:01 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05
Apr 06 16:54:01 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:01 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.540s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Deleted volume successfully.
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eeddb741-d1d4-4d24-a73e-32f3f16997ee tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-dd52c5a6-3dff-4565-87d2-2cbf8bdaf869-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Flow 'volume_create_manager' (916c544a-bd12-496e-ab6a-6f01c4ccd258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6a7ee0-0fa3-424b-a001-9e28f9168d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6a7ee0-0fa3-424b-a001-9e28f9168d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-973420743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37beabc37c1f42468913c56cec78c1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:02Z,use_quota=True,user_id='d988a957a8f3490a878299261ee15492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebcab73-9285-4842-aae4-5b21b484f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ebcab73-9285-4842-aae4-5b21b484f344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e1a1ef-2a98-443f-878b-eab985ddef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e1a1ef-2a98-443f-878b-eab985ddef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85', 'volume_name': 'volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ef7869-4678-4404-812a-e60c047e1084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ef7869-4678-4404-812a-e60c047e1084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c771b5d-3711-4035-a487-b59c18482bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:01 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Volume 748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85', 'volume_size': 1}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-973420743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37beabc37c1f42468913c56cec78c1e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:02Z,use_quota=True,user_id='d988a957a8f3490a878299261ee15492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Creating volume 748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:01 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:01 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 1073741824
Apr 06 16:54:01 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:01 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025" returned: 0 in 0.619s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:01 devstack sudo[87258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025
Apr 06 16:54:01 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:01 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05" returned: 0 in 0.734s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:02 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05
Apr 06 16:54:02 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:02 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f4bcd35b-8895-4ba6-8ec9-912aae447025" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-quobyte-f4bcd35b-8895-4ba6-8ec9-912aae447025" released by "delete_volume" :: held 1.091s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.quota [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Created reservations ['7b4281e9-bc14-41ad-bbdc-644588bb7720', 'f46455d8-da29-4133-85ab-61659789835f', '0e1e3907-4819-42c5-98f9-9011fc09ecaf', 'd113a262-1376-4ef6-8da0-3749c4929c2c'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:02 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 1073741824" returned: 0 in 0.588s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:02 devstack sudo[87269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:02 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:02 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85
Apr 06 16:54:02 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:02 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0433944f-81b1-4046-a74c-4fa46490db05" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "cinder-quobyte-0433944f-81b1-4046-a74c-4fa46490db05" released by "delete_volume" :: held 1.242s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Created reservations ['05a6019b-a1eb-4a81-a7cd-41637e4416ba', '0718bc98-3722-40ef-8a91-722b02b45937', 'b78f9434-6798-460c-a1d1-e24756733d05', '644e2204-6933-479b-9fee-e45c072663af'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:02 devstack sudo[87274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:02 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:02 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.463s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.manager [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Deleted volume successfully.
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [req-b55fad2c-f536-4fbe-8390-4991dd7b5319 req-a45da8b7-6bdd-412b-a664-7c2975022e81 tempest-ServerBootFromVolumeStableRescueTest-304154173 None] Lock "cinder-f4bcd35b-8895-4ba6-8ec9-912aae447025-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:02 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.483s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c771b5d-3711-4035-a487-b59c18482bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a761988-0712-43a8-9c71-d295f55fee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b245200c-c207-4ee4-941a-63e72d7fe2ef]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Volume volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 (748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85): created successfully
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a761988-0712-43a8-9c71-d295f55fee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Flow 'volume_create_manager' (916c544a-bd12-496e-ab6a-6f01c4ccd258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a59671a1-d9a9-45c0-aeee-3260ded30a86 tempest-VolumesTransfersTest-1155668289 None] Created volume successfully.
Apr 06 16:54:02 devstack sudo[87278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:02 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:03 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.448s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Deleted volume successfully.
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a298f3d2-7771-49da-b90f-28ccb9160de4 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "cinder-0433944f-81b1-4046-a74c-4fa46490db05-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:03 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b6f5a-6c65-46a7-afcc-510f7222a3e4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:03 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:03 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:03 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:03 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Flow 'volume_create_manager' (ff21a2d8-197e-4317-9fe8-685977c00972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bec74e-a813-4633-8d27-90b587bb5177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bec74e-a813-4633-8d27-90b587bb5177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2116176142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fe5a0e-5b26-4cca-b3e9-b196c197ac0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560e3afb20394ca8b42c5c515ee065d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:04Z,use_quota=True,user_id='be483d05f6614d5e863ed82c723818f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc552af0-4d3f-4d60-b408-66f2d481963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc552af0-4d3f-4d60-b408-66f2d481963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b97f35-c2cc-4b66-9e49-8acb7cba9a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b97f35-c2cc-4b66-9e49-8acb7cba9a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25fe5a0e-5b26-4cca-b3e9-b196c197ac0c', 'volume_name': 'volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2b1fe6-0e88-42f2-9f1c-e3f940e73a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2b1fe6-0e88-42f2-9f1c-e3f940e73a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b54759f-f231-4cf8-96aa-847e345325e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:03 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Volume 25fe5a0e-5b26-4cca-b3e9-b196c197ac0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c', 'volume_size': 1}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:03 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.528s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f6843283-83f1-440e-bb72-8405359d9aeajpyw4ehl.img {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:03 devstack sudo[87292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f6843283-83f1-440e-bb72-8405359d9aeajpyw4ehl.img
Apr 06 16:54:03 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Acquiring lock "cinder-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Acquiring lock "cinder-quobyte-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-quobyte-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeea7f1-fe86-4636-a5c3-4d2604e37343]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:04 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85
Apr 06 16:54:04 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:04 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.508s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:04 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85" returned: 0 in 0.817s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:04 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85
Apr 06 16:54:04 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:06 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85" returned: 0 in 1.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-quobyte-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85" released by "delete_volume" :: held 2.289s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Created reservations ['dede1607-a010-4638-baed-a693063caf7e', 'f525a115-5f44-41bc-95cd-54ee3af8dc52', 'b7dad58b-8003-4929-8fa7-cc61ca393dc3', '32163d74-c8ec-48af-92ad-55c571f895ca'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:06 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:06 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:06 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f6843283-83f1-440e-bb72-8405359d9aeajpyw4ehl.img" returned: 0 in 2.561s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f040bfa-4b23-49c3-b162-f6ac39fff06f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:06 devstack sudo[87345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:06 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:06 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Deleted volume successfully.
Apr 06 16:54:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cc1789fe-3ac0-4fdf-8ebf-401df9e73c3e tempest-VolumesTransfersTest-1114460344 None] Lock "cinder-748a38fb-cdd3-4f4c-ae68-d5f8efa2eb85-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:07 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.642s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:07 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4, size 1024.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f6843283-83f1-440e-bb72-8405359d9aeajpyw4ehl.img {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:54:07 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Converted 1024.00 MB image at 399.70 MB/s
Apr 06 16:54:07 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] f6843283-83f1-440e-bb72-8405359d9aea was raw, no need to convert to raw {{(pid=82421) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Flow 'volume_create_manager' (632fecf2-24e6-4097-8be2-d72f6591b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d3adb0-e1b9-4825-b9db-bebca12fe53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d3adb0-e1b9-4825-b9db-bebca12fe53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1984338108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef82710a-6e6d-441b-9209-fff8ef2f2153,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='633b25fb892b46118ff1e1ed0c69708c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:11Z,use_quota=True,user_id='da0748a28a1746588dc71dac90fd569b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8eaf85-9024-40f9-9862-47f24320feae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8eaf85-9024-40f9-9862-47f24320feae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17fefb5-9a36-47c9-9a91-211a4a3db715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17fefb5-9a36-47c9-9a91-211a4a3db715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef82710a-6e6d-441b-9209-fff8ef2f2153', 'volume_name': 'volume-ef82710a-6e6d-441b-9209-fff8ef2f2153', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6d4634-afae-455f-9136-3a861fad5041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6d4634-afae-455f-9136-3a861fad5041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0cb1b5-ff30-46d6-a0d2-dbb0ec6166bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Volume ef82710a-6e6d-441b-9209-fff8ef2f2153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef82710a-6e6d-441b-9209-fff8ef2f2153', 'volume_size': 1}
Apr 06 16:54:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b159cdc1-a559-4282-9bf0-d404c3658e28 tempest-GroupSnapshotsTest-1528255746 None] Group tempest-GroupSnapshotsTest-Group-1710147873: creating
Apr 06 16:54:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b159cdc1-a559-4282-9bf0-d404c3658e28 tempest-GroupSnapshotsTest-1528255746 None] Group tempest-GroupSnapshotsTest-Group-1710147873: created successfully
Apr 06 16:54:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b159cdc1-a559-4282-9bf0-d404c3658e28 tempest-GroupSnapshotsTest-1528255746 None] Create group completed successfully.
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (73ddcaba-c867-4603-8bbb-ddc7f7d9300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b2ab35-f68b-4389-95a6-57d0d103d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b2ab35-f68b-4389-95a6-57d0d103d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866501776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b172faf3-f672-4bda-af3b-a7f84d190c19,host='devstack@QuobyteHD#QuobyteHD',id=f21848da-1ae6-44ae-99f9-2c9e5c7c2c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:17Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d255b3-7ba7-44d6-8380-16ee467990e0),volume_type_id=59d255b3-7ba7-44d6-8380-16ee467990e0)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bf2616-37e7-448f-ae69-ff2a21b8ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bf2616-37e7-448f-ae69-ff2a21b8ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fa98d0-a93a-4af9-be6d-79410689bbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fa98d0-a93a-4af9-be6d-79410689bbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21848da-1ae6-44ae-99f9-2c9e5c7c2c14', 'volume_name': 'volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ef3e7b-d2b8-43bd-be5a-acaa11a7e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ef3e7b-d2b8-43bd-be5a-acaa11a7e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bd7a4f-6a5a-45ff-a884-f16acfe40de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:17 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Volume f21848da-1ae6-44ae-99f9-2c9e5c7c2c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14', 'volume_size': 1}
Apr 06 16:54:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.256s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Uploaded volume to glance image-id: f6843283-83f1-440e-bb72-8405359d9aea. {{(pid=82421) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.302s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2116176142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25fe5a0e-5b26-4cca-b3e9-b196c197ac0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='560e3afb20394ca8b42c5c515ee065d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:04Z,use_quota=True,user_id='be483d05f6614d5e863ed82c723818f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Creating volume 25fe5a0e-5b26-4cca-b3e9-b196c197ac0c {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:18 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:18 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c 1073741824
Apr 06 16:54:18 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:18 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1192667e-2957-4fd9-8783-709ac53851ca tempest-VolumesActionsTest-324770953 None] Copy volume to image completed successfully.
Apr 06 16:54:18 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c 1073741824" returned: 0 in 0.491s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:18 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c
Apr 06 16:54:18 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:19 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c" returned: 0 in 0.409s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.114s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1984338108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef82710a-6e6d-441b-9209-fff8ef2f2153,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='633b25fb892b46118ff1e1ed0c69708c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:11Z,use_quota=True,user_id='da0748a28a1746588dc71dac90fd569b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Creating volume ef82710a-6e6d-441b-9209-fff8ef2f2153 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:19 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b54759f-f231-4cf8-96aa-847e345325e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65895709-4930-4590-aecb-2a13a76d4885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:19 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 1073741824
Apr 06 16:54:19 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:19 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Volume volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c (25fe5a0e-5b26-4cca-b3e9-b196c197ac0c): created successfully
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65895709-4930-4590-aecb-2a13a76d4885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Flow 'volume_create_manager' (ff21a2d8-197e-4317-9fe8-685977c00972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:19 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5f245f59-dd24-4fe9-b99b-dc4a95a04196 tempest-VolumeQuotasAdminTestJSON-202360159 None] Created volume successfully.
Apr 06 16:54:19 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 1073741824" returned: 0 in 0.496s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:19 devstack sudo[87410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153
Apr 06 16:54:19 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:19 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:19 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1db64632-e77d-4b00-acbe-a9b6e34b0f7d tempest-VolumeQuotasAdminTestJSON-1759041832 None] Transfer volume completed successfully.
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.482s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b172faf3-f672-4bda-af3b-a7f84d190c19,created_at=2026-04-06T14:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866501776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b172faf3-f672-4bda-af3b-a7f84d190c19,host='devstack@QuobyteHD#QuobyteHD',id=f21848da-1ae6-44ae-99f9-2c9e5c7c2c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:17Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d255b3-7ba7-44d6-8380-16ee467990e0),volume_type_id=59d255b3-7ba7-44d6-8380-16ee467990e0)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Creating volume f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:19 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0cb1b5-ff30-46d6-a0d2-dbb0ec6166bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef82710a-6e6d-441b-9209-fff8ef2f2153', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 1073741824
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e795cda-de41-4c15-8254-7737af2a33cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:20 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:20 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Volume volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 (ef82710a-6e6d-441b-9209-fff8ef2f2153): created successfully
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e795cda-de41-4c15-8254-7737af2a33cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Flow 'volume_create_manager' (632fecf2-24e6-4097-8be2-d72f6591b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:20 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ab245e58-12c9-4615-8621-477d20668b05 tempest-VolumesListTestJSON-1801331087 None] Created volume successfully.
Apr 06 16:54:20 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 1073741824" returned: 0 in 0.465s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:20 devstack sudo[87418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:20 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Flow 'volume_create_manager' (b544f975-c132-47bc-a22c-b74b9df5cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd1fa6f-34d3-49ef-b00b-b30fae91a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd1fa6f-34d3-49ef-b00b-b30fae91a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1268176732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8e304-210c-45dc-997b-8d37b13ac2e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='633b25fb892b46118ff1e1ed0c69708c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:21Z,use_quota=True,user_id='da0748a28a1746588dc71dac90fd569b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c11b2d-7105-427a-a979-2ea242bb224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c11b2d-7105-427a-a979-2ea242bb224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86038b6b-49ab-4a40-8d40-7c3828538fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86038b6b-49ab-4a40-8d40-7c3828538fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f8e304-210c-45dc-997b-8d37b13ac2e3', 'volume_name': 'volume-49f8e304-210c-45dc-997b-8d37b13ac2e3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7eddbe-8aa7-4fea-94e0-3cc32edb47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7eddbe-8aa7-4fea-94e0-3cc32edb47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae717eb9-42ac-4fec-b70a-82e08c58ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:20 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Volume 49f8e304-210c-45dc-997b-8d37b13ac2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f8e304-210c-45dc-997b-8d37b13ac2e3', 'volume_size': 1}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Acquiring lock "cinder-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Lock "cinder-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Acquiring lock "cinder-quobyte-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Lock "cinder-quobyte-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[54324da5-e3eb-4976-ac11-a4b2656aa8f3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:20 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c
Apr 06 16:54:20 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:20 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.425s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e71455-9de2-49b9-89c5-f6b9976adb0e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bd7a4f-6a5a-45ff-a884-f16acfe40de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:20 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bf6a75-a4a4-477d-900c-205a2113d912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:21 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Volume volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 (f21848da-1ae6-44ae-99f9-2c9e5c7c2c14): created successfully
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bf6a75-a4a4-477d-900c-205a2113d912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (73ddcaba-c867-4603-8bbb-ddc7f7d9300f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8812f132-79ef-4e54-bccc-db19c6e1f3ae tempest-GroupSnapshotsTest-1528255746 None] Created volume successfully.
Apr 06 16:54:21 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:21 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:21 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c" returned: 0 in 0.457s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:21 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c
Apr 06 16:54:21 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:21 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e36d8e-56e3-42d0-8583-0e8e6120242c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:21 devstack sudo[87433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:21 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:21 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c" returned: 0 in 0.407s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Lock "cinder-quobyte-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c" released by "delete_volume" :: held 0.897s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=117,cinder:INSERT=43,cinder:UPDATE=123,cinder:DELETE=17 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=120,cinder:INSERT=26,cinder:UPDATE=155,cinder:DELETE=5 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Created reservations ['4dd40899-61e6-443c-a13f-1a77d1039048', '87abf2cd-40f3-4547-a12d-e68f60f4e529', '14826c4b-c924-43df-beff-791929613ffd', '7752d081-134d-48d8-a797-9b9bcc8bf020'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:21 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:21 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] GroupSnapshot e245c28a-d3c2-482f-89b7-2d7a9d2796e0: creating.
Apr 06 16:54:21 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.517s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Group snapshot e245c28a-d3c2-482f-89b7-2d7a9d2796e0: creating. {{(pid=82421) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}}
Apr 06 16:54:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:21 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img
Apr 06 16:54:21 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:22 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.489s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:22 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Deleted volume successfully.
Apr 06 16:54:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ed6d61b2-3fe8-40bc-b1ca-2c75682ec642 tempest-VolumeQuotasAdminTestJSON-194031453 None] Lock "cinder-25fe5a0e-5b26-4cca-b3e9-b196c197ac0c-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:24 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img" returned: 0 in 2.304s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[18af5145-4cb7-43aa-bb01-61539e63c9ce]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:24 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:24 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:24 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.705s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:24 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:54:24 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Converted 1024.00 MB image at 444.19 MB/s
Apr 06 16:54:24 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] f7165dd1-f985-4971-9839-9a04498a10d4 was raw, converting to qcow2 {{(pid=82421) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[071f0f6f-a2ec-4f9d-9e84-b1a93e9540b9]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:25 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img
Apr 06 16:54:25 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:25 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img" returned: 0 in 0.472s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:25 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img
Apr 06 16:54:25 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:25 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img" returned: 1 in 0.500s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:54:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img /opt/stack/data/cinder/conversion/vol_upload_dstou5mb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:26 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img /opt/stack/data/cinder/conversion/vol_upload_dstou5mb
Apr 06 16:54:26 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:26 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img /opt/stack/data/cinder/conversion/vol_upload_dstou5mb" returned: 0 in 0.417s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:26 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Image conversion details: src /opt/stack/data/cinder/conversion/fab92e2a-d6fa-4d66-9502-25577a600be4.temp_image.f7165dd1-f985-4971-9839-9a04498a10d4cqobjmvk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dstou5mb {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:54:26 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 06 16:54:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c811ad6-2627-4991-a307-4d01712d49c8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dstou5mb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:26 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dstou5mb
Apr 06 16:54:26 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:26 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dstou5mb" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.894s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Uploaded volume to glance image-id: f7165dd1-f985-4971-9839-9a04498a10d4. {{(pid=82421) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.137s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1268176732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8e304-210c-45dc-997b-8d37b13ac2e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='633b25fb892b46118ff1e1ed0c69708c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:21Z,use_quota=True,user_id='da0748a28a1746588dc71dac90fd569b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Creating volume 49f8e304-210c-45dc-997b-8d37b13ac2e3 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:27 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:27 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 1073741824
Apr 06 16:54:27 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:27 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fd80c392-b76d-4d0b-b20d-6a6f6374ffb2 tempest-VolumesActionsTest-324770953 None] Copy volume to image completed successfully.
Apr 06 16:54:28 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 1073741824" returned: 0 in 0.543s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:28 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3
Apr 06 16:54:28 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:28 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3" returned: 0 in 0.418s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.891s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Creating offline snapshot 3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea of volume f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae717eb9-42ac-4fec-b70a-82e08c58ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f8e304-210c-45dc-997b-8d37b13ac2e3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b6d251-8066-4f5a-9653-6a95d9b3c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c0a579-7c6d-463b-a049-621e98c68548]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:28 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Volume volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 (49f8e304-210c-45dc-997b-8d37b13ac2e3): created successfully
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b6d251-8066-4f5a-9653-6a95d9b3c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Flow 'volume_create_manager' (b544f975-c132-47bc-a22c-b74b9df5cb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:28 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ecd95fa8-f518-4d02-b43a-2d4d6110bfee tempest-VolumesListTestJSON-1801331087 None] Created volume successfully.
Apr 06 16:54:28 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:28 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Flow 'volume_create_manager' (66d33f2f-9f0d-45f1-afb5-ce39f4db2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c0aaa6-6efd-416e-909b-a74595331248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c0aaa6-6efd-416e-909b-a74595331248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-46063225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e8e627912a4f9783da6379b1f5b50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:29Z,use_quota=True,user_id='1949ff632ba54099bf83d9925a39d7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f112f3d-b890-4ffd-9098-c2839f5bdff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f112f3d-b890-4ffd-9098-c2839f5bdff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f57c8e-5d15-4086-aa6b-61b6403ec260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f57c8e-5d15-4086-aa6b-61b6403ec260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81', 'volume_name': 'volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481333e7-d537-46ba-a1c7-f36319d14a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481333e7-d537-46ba-a1c7-f36319d14a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b563e3aa-adb7-4428-b553-a735bd1265d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Volume f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81', 'volume_size': 1}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Acquiring lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Acquiring lock "cinder-quobyte-fab92e2a-d6fa-4d66-9502-25577a600be4" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Lock "cinder-quobyte-fab92e2a-d6fa-4d66-9502-25577a600be4" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[964487d1-2f02-40a9-a782-02044840816e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:29 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.566s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:29 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea 1G
Apr 06 16:54:29 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:29 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:29 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Flow 'volume_create_manager' (dbdf19ff-dfd3-4d6f-b3c0-8ab324eed6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a1a5d9-40b4-4dc1-9118-1df13a14a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a1a5d9-40b4-4dc1-9118-1df13a14a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-588750808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b02258-984f-46f3-b35f-ab887c486a22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='633b25fb892b46118ff1e1ed0c69708c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:30Z,use_quota=True,user_id='da0748a28a1746588dc71dac90fd569b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e218466f-2f4a-457a-be8d-93082bac2780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e218466f-2f4a-457a-be8d-93082bac2780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f246f740-9467-4c92-b961-8c4b06fb0303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f246f740-9467-4c92-b961-8c4b06fb0303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b02258-984f-46f3-b35f-ab887c486a22', 'volume_name': 'volume-46b02258-984f-46f3-b35f-ab887c486a22', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd3feb4-5bfb-4b8d-bf67-5e2567cfb36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd3feb4-5bfb-4b8d-bf67-5e2567cfb36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a625655-0f53-4a6e-9101-288b9b040c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:29 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Volume 46b02258-984f-46f3-b35f-ab887c486a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b02258-984f-46f3-b35f-ab887c486a22', 'volume_size': 1}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:29 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea 1G" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:29 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea
Apr 06 16:54:29 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:29 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.522s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:29 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4
Apr 06 16:54:29 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:30 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" returned: 0 in 0.436s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:30 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:30 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:30 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea
Apr 06 16:54:30 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fab92e2a-d6fa-4d66-9502-25577a600be4" returned: 0 in 0.395s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Lock "cinder-quobyte-fab92e2a-d6fa-4d66-9502-25577a600be4" released by "delete_volume" :: held 0.955s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Created reservations ['e53e066e-bab4-4cfb-a060-31ad97c27f15', 'e86dadfc-ba48-48d3-8204-1c5d695aa934', '2cf5671c-7ea7-4dad-8226-0b2a991b9429', '7a3ab642-b7d5-4569-8d6c-89643eae9e72'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:30 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:30 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:30 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" returned: 0 in 0.405s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:30 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info
Apr 06 16:54:30 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:30 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Deleted volume successfully.
Apr 06 16:54:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6ba851a4-d2b1-4e79-afec-636bf6fec1c0 tempest-VolumesActionsTest-324770953 None] Lock "cinder-fab92e2a-d6fa-4d66-9502-25577a600be4-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:31 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info" returned: 0 in 0.463s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:31 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:31 devstack sudo[87521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info
Apr 06 16:54:31 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:31 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.info" returned: 0 in 0.418s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.374s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-46063225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e8e627912a4f9783da6379b1f5b50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:29Z,use_quota=True,user_id='1949ff632ba54099bf83d9925a39d7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Creating volume f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:31 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:31 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 1073741824
Apr 06 16:54:31 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:31 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-faa35ee7-2d1d-4f12-9f84-399caaa1ba10 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot e245c28a-d3c2-482f-89b7-2d7a9d2796e0: created successfully
Apr 06 16:54:32 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 1073741824" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:32 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81
Apr 06 16:54:32 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:32 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81" returned: 0 in 0.479s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-588750808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b02258-984f-46f3-b35f-ab887c486a22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='633b25fb892b46118ff1e1ed0c69708c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:30Z,use_quota=True,user_id='da0748a28a1746588dc71dac90fd569b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Creating volume 46b02258-984f-46f3-b35f-ab887c486a22 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:32 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b563e3aa-adb7-4428-b553-a735bd1265d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67794c82-5fc2-4620-8345-b7e77b7bb21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:32 devstack sudo[87533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22 1073741824
Apr 06 16:54:32 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:32 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Volume volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 (f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81): created successfully
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67794c82-5fc2-4620-8345-b7e77b7bb21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Flow 'volume_create_manager' (66d33f2f-9f0d-45f1-afb5-ce39f4db2da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:32 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-65e91cef-3ce8-4123-91aa-d40d1b92842a tempest-VolumesTransfersV355Test-10954972 None] Created volume successfully.
Apr 06 16:54:33 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22 1073741824" returned: 0 in 0.597s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:33 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22
Apr 06 16:54:33 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:33 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22" returned: 0 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.449s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea-b2297c58-6896-4c12-82f5-b181164cae58" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a625655-0f53-4a6e-9101-288b9b040c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b02258-984f-46f3-b35f-ab887c486a22', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4816fba8-424c-4f3e-9777-345a2e6ed5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Volume volume-46b02258-984f-46f3-b35f-ab887c486a22 (46b02258-984f-46f3-b35f-ab887c486a22): created successfully
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4816fba8-424c-4f3e-9777-345a2e6ed5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Flow 'volume_create_manager' (dbdf19ff-dfd3-4d6f-b3c0-8ab324eed6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea-b2297c58-6896-4c12-82f5-b181164cae58" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Creating volume b2297c58-6896-4c12-82f5-b181164cae58 from snapshot 3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-b2297c58-6896-4c12-82f5-b181164cae58" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-92f3fdd7-2172-4014-9bd9-b5598bb4d48a tempest-VolumesListTestJSON-1801331087 None] Created volume successfully.
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b2297c58-6896-4c12-82f5-b181164cae58" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] snapshot: 3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea, volume: b2297c58-6896-4c12-82f5-b181164cae58,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a2da7-2809-4777-a76c-02551f39032f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e860c42f-3333-4787-b891-5cd644dde26d tempest-VolumesTransfersV355Test-1561245292 None] Transfer volume completed successfully.
Apr 06 16:54:33 devstack sudo[87543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea
Apr 06 16:54:33 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Flow 'volume_create_manager' (b3814408-2e16-4669-9fc4-c6931026f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59052c01-1081-4173-ba2c-1f74982bc325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59052c01-1081-4173-ba2c-1f74982bc325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1987827995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771b028e-f116-41af-b08d-a8b1a1fd3069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab2c9a3b671439db25467e94a2da567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:34Z,use_quota=True,user_id='114b8c12f8094176a36c7cc9e6725333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75933a94-61a8-4807-8c1a-b4874dffd01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75933a94-61a8-4807-8c1a-b4874dffd01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d117dd5f-895d-44dd-a8cc-b14cb3c95271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d117dd5f-895d-44dd-a8cc-b14cb3c95271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771b028e-f116-41af-b08d-a8b1a1fd3069', 'volume_name': 'volume-771b028e-f116-41af-b08d-a8b1a1fd3069', 'volume_size': 2}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76b166b-1b7c-4fc6-a3c4-f2336456b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76b166b-1b7c-4fc6-a3c4-f2336456b316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7982b8ad-0b0b-49ad-8978-82f6941e8a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Volume 771b028e-f116-41af-b08d-a8b1a1fd3069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771b028e-f116-41af-b08d-a8b1a1fd3069', 'volume_size': 2}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:34 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb27dcf-f003-4a79-a6ce-579e2d701e1c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:34 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:34 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Acquiring lock "cinder-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Acquiring lock "cinder-quobyte-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-quobyte-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea8c8a9-30d8-4efa-91b8-b3ba49fa29b9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:34 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.544s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:54:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:34 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81
Apr 06 16:54:34 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:34 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58
Apr 06 16:54:34 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:35 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81" returned: 0 in 0.535s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:35 devstack sudo[87569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81
Apr 06 16:54:35 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:36 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81" returned: 0 in 0.843s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-quobyte-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81" released by "delete_volume" :: held 1.421s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Created reservations ['13b0a4f6-ed07-4779-ba84-22ad6f324afc', '4f180fd1-2555-4c76-ae30-a91859bfe9e9', 'afc81ba5-cb2a-4968-9b42-e02565585bde', 'd0ac4378-c8bc-4f46-be68-8c024b628608'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:36 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:36 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:37 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58" returned: 0 in 2.540s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb202f-fdcc-461f-ab2d-7754430ccdf3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:37 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.903s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:37 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Deleted volume successfully.
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fb9abde4-c6f0-4b7c-93cc-7faf121adae1 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-f67bdc36-f4a3-46b3-bb99-0bcb5fd0ae81-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:37 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:37 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Flow 'volume_create_manager' (3a87152d-6e2a-4651-b865-3c8466d9dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82820cee-5544-4eb6-a34a-d47c3c15dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82820cee-5544-4eb6-a34a-d47c3c15dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1621982269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc9e817-eeb1-422b-a971-455453a5053e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e8e627912a4f9783da6379b1f5b50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:38Z,use_quota=True,user_id='1949ff632ba54099bf83d9925a39d7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dff085-d9a9-4ddc-8b63-4d71fc7b7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dff085-d9a9-4ddc-8b63-4d71fc7b7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87c7723-febf-41e0-8c56-2d1cbd141598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87c7723-febf-41e0-8c56-2d1cbd141598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc9e817-eeb1-422b-a971-455453a5053e', 'volume_name': 'volume-3fc9e817-eeb1-422b-a971-455453a5053e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c72d43-79ea-41a7-a163-b51558cd1097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c72d43-79ea-41a7-a163-b51558cd1097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6816e2-4f4d-44a0-b1c1-cedb4fbee123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:37 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Volume 3fc9e817-eeb1-422b-a971-455453a5053e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc9e817-eeb1-422b-a971-455453a5053e', 'volume_size': 1}
Apr 06 16:54:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "cinder-46b02258-984f-46f3-b35f-ab887c486a22-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-46b02258-984f-46f3-b35f-ab887c486a22-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "cinder-quobyte-46b02258-984f-46f3-b35f-ab887c486a22" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-quobyte-46b02258-984f-46f3-b35f-ab887c486a22" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf7543f-fe4a-418a-93fb-14a713861b69]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:38 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.688s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:54:38 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Converted 1024.00 MB image at 402.90 MB/s
Apr 06 16:54:38 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:38 devstack sudo[87583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22
Apr 06 16:54:38 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:38 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58
Apr 06 16:54:38 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:38 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:38 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58" returned: 0 in 0.395s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b2297c58-6896-4c12-82f5-b181164cae58" released by "_copy_volume_from_snapshot" :: held 4.737s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:38 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea-b2297c58-6896-4c12-82f5-b181164cae58" released by "_create_volume_from_snapshot" :: held 4.759s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.803s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:38 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.230s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1987827995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771b028e-f116-41af-b08d-a8b1a1fd3069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab2c9a3b671439db25467e94a2da567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:34Z,use_quota=True,user_id='114b8c12f8094176a36c7cc9e6725333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Creating volume 771b028e-f116-41af-b08d-a8b1a1fd3069 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:38 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069 2147483648 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:38 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069 2147483648
Apr 06 16:54:38 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-96718160-d069-4d5a-be61-0f14b79f04ff tempest-GroupSnapshotsTest-1528255746 None] Create group from source-snapshot-e245c28a-d3c2-482f-89b7-2d7a9d2796e0 completed successfully.
Apr 06 16:54:38 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-46b02258-984f-46f3-b35f-ab887c486a22" returned: 0 in 0.410s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-quobyte-46b02258-984f-46f3-b35f-ab887c486a22" released by "delete_volume" :: held 0.883s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:38 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Created reservations ['e9fc29bb-3462-4dbe-ba23-92dc52dc9dfc', '7d3c87c7-57ab-492d-a968-a53464c25804', 'ad34bc7e-8ec7-4136-93a0-b06bd7836dd4', 'f4e84d4f-beea-4dba-af3d-4a4f09e60fd0'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:39 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:39 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:39 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069 2147483648" returned: 0 in 0.522s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:39 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069
Apr 06 16:54:39 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "cinder-49f8e304-210c-45dc-997b-8d37b13ac2e3-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-49f8e304-210c-45dc-997b-8d37b13ac2e3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "cinder-quobyte-49f8e304-210c-45dc-997b-8d37b13ac2e3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-quobyte-49f8e304-210c-45dc-997b-8d37b13ac2e3" acquired by "delete_volume" :: waited 0.019s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e44f8b-2fdd-49aa-ab94-7857d6b9b673]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:39 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3
Apr 06 16:54:39 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:39 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Deleted volume successfully.
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-b2297c58-6896-4c12-82f5-b181164cae58" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c156849b-d8f9-42a4-b7bd-b8c50221afa9 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-46b02258-984f-46f3-b35f-ab887c486a22-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b2297c58-6896-4c12-82f5-b181164cae58" acquired by "delete_volume" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55127b4d-c80f-40f2-a5e7-777fba8e2b48]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:39 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069" returned: 0 in 0.488s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1621982269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc9e817-eeb1-422b-a971-455453a5053e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e8e627912a4f9783da6379b1f5b50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:38Z,use_quota=True,user_id='1949ff632ba54099bf83d9925a39d7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Creating volume 3fc9e817-eeb1-422b-a971-455453a5053e {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:39 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:39 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58
Apr 06 16:54:39 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:39 devstack sudo[87608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e 1073741824
Apr 06 16:54:39 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7982b8ad-0b0b-49ad-8978-82f6941e8a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771b028e-f116-41af-b08d-a8b1a1fd3069', 'volume_size': 2}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677da71f-d7b8-447d-9e8d-7605edd654f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:39 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Volume volume-771b028e-f116-41af-b08d-a8b1a1fd3069 (771b028e-f116-41af-b08d-a8b1a1fd3069): created successfully
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677da71f-d7b8-447d-9e8d-7605edd654f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Flow 'volume_create_manager' (b3814408-2e16-4669-9fc4-c6931026f662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ab743e00-a0fb-40f8-8bd6-abb8797db29b tempest-VolumesCloneNegativeTest-521389995 None] Created volume successfully.
Apr 06 16:54:39 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3" returned: 0 in 0.539s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:39 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3
Apr 06 16:54:39 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:40 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58" returned: 0 in 0.502s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:40 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58
Apr 06 16:54:40 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:40 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e 1073741824" returned: 0 in 0.496s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:40 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e
Apr 06 16:54:40 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:40 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-49f8e304-210c-45dc-997b-8d37b13ac2e3" returned: 0 in 0.426s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-quobyte-49f8e304-210c-45dc-997b-8d37b13ac2e3" released by "delete_volume" :: held 0.992s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Created reservations ['6c29490b-25a6-4a78-987f-39697b7f132a', 'e3416310-3f97-4324-a875-e525a73d2da2', '2bcc79e4-0960-4482-a46b-496dc3eec9bf', 'c6937af3-0fa3-4e7f-82ac-c78689ecae96'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:40 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:40 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:40 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b2297c58-6896-4c12-82f5-b181164cae58" returned: 0 in 0.410s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b2297c58-6896-4c12-82f5-b181164cae58" released by "delete_volume" :: held 0.943s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['710f911e-3a11-400f-b8db-6038a632f51d'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:40 devstack cinder-volume[82421]: WARNING cinder.quota [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-781975367 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-781975367, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:54:40 devstack cinder-volume[82421]: WARNING cinder.quota [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-781975367 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-781975367, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['49014f03-3554-468a-bbc6-562bd8cea321', '56e977f4-4ccd-4120-b3f3-e59d9078a11e', '6cbf0e18-5d3d-4bec-bcae-8261c3bafb88', '7a8d4d29-ceb9-4ff5-aceb-0c6c6af84dd9'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:40 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6816e2-4f4d-44a0-b1c1-cedb4fbee123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc9e817-eeb1-422b-a971-455453a5053e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da5cccd-4597-4725-8af6-aabbc77551f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:40 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Volume volume-3fc9e817-eeb1-422b-a971-455453a5053e (3fc9e817-eeb1-422b-a971-455453a5053e): created successfully
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da5cccd-4597-4725-8af6-aabbc77551f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Flow 'volume_create_manager' (3a87152d-6e2a-4651-b865-3c8466d9dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-29208af4-7d48-419a-b730-302a85b67c2c tempest-VolumesTransfersV355Test-10954972 None] Created volume successfully.
Apr 06 16:54:40 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:40 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:40 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.408s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Deleted volume successfully.
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4ea7d296-cfa3-46b3-b072-78889e34370d tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-49f8e304-210c-45dc-997b-8d37b13ac2e3-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Acquiring lock "cinder-771b028e-f116-41af-b08d-a8b1a1fd3069-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Lock "cinder-771b028e-f116-41af-b08d-a8b1a1fd3069-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Acquiring lock "cinder-quobyte-771b028e-f116-41af-b08d-a8b1a1fd3069" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Lock "cinder-quobyte-771b028e-f116-41af-b08d-a8b1a1fd3069" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132ebd8-b199-43bc-8b53-091aa4acb2d2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Acquiring lock "cinder-3fc9e817-eeb1-422b-a971-455453a5053e-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:40 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069
Apr 06 16:54:40 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-3fc9e817-eeb1-422b-a971-455453a5053e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Acquiring lock "cinder-quobyte-3fc9e817-eeb1-422b-a971-455453a5053e" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-quobyte-3fc9e817-eeb1-422b-a971-455453a5053e" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e3e5e-0024-4e56-85bd-4ae6d343c253]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:41 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:41 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b08f14e3-08aa-49c8-92b7-2a06b78ea878 tempest-GroupSnapshotsTest-1528255746 None] Delete group completed successfully.
Apr 06 16:54:41 devstack sudo[87637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e
Apr 06 16:54:41 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:41 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069" returned: 0 in 0.483s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:41 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069
Apr 06 16:54:41 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "cinder-ef82710a-6e6d-441b-9209-fff8ef2f2153-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-ef82710a-6e6d-441b-9209-fff8ef2f2153-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "cinder-quobyte-ef82710a-6e6d-441b-9209-fff8ef2f2153" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-quobyte-ef82710a-6e6d-441b-9209-fff8ef2f2153" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aedf17-2325-416a-955b-d5f5f16498f1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:41 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:41 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e
Apr 06 16:54:41 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:41 devstack sudo[87647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153
Apr 06 16:54:41 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:41 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot e245c28a-d3c2-482f-89b7-2d7a9d2796e0: deleting
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot e245c28a-d3c2-482f-89b7-2d7a9d2796e0: deleting {{(pid=82421) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Deleting offline snapshot 3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea of volume f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] snapshot_file for this snap is: volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7da924-4cda-49c2-afe5-958caee59d95]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:41 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-771b028e-f116-41af-b08d-a8b1a1fd3069" returned: 0 in 0.473s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Lock "cinder-quobyte-771b028e-f116-41af-b08d-a8b1a1fd3069" released by "delete_volume" :: held 0.978s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Created reservations ['1b5a47b9-3556-4c02-89f5-8a6c79626ddb', '56cca856-cd73-4d80-92f5-28baac4f53b2', 'ced1923d-1303-4b60-b614-7673624e448b', '5844acd6-2dd1-4eab-b812-ecfe8e794d7d'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:41 devstack sudo[87652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea
Apr 06 16:54:41 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:42 devstack sudo[87658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:42 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:42 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153" returned: 0 in 0.515s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3fc9e817-eeb1-422b-a971-455453a5053e" returned: 0 in 0.479s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-quobyte-3fc9e817-eeb1-422b-a971-455453a5053e" released by "delete_volume" :: held 1.008s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:42 devstack sudo[87660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153
Apr 06 16:54:42 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Created reservations ['40ab5a2e-3d2f-4943-9d8b-679436256862', '4a927751-927e-47cc-87b7-3afc7068feb6', '9b5a72c8-218d-4e8d-b4e9-646bc7882275', '638525ff-9b59-41c4-804d-8ddb42401afd'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:42 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:42 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:42 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" returned: 0 in 0.570s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d9ef8-4477-4c15-940f-0bc20ebf730b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:42 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.436s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Deleted volume successfully.
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1a445bf6-5d52-4844-ad22-8e91e55991c2 tempest-VolumesCloneNegativeTest-521389995 None] Lock "cinder-771b028e-f116-41af-b08d-a8b1a1fd3069-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:42 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:42 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:42 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ef82710a-6e6d-441b-9209-fff8ef2f2153" returned: 0 in 0.473s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-quobyte-ef82710a-6e6d-441b-9209-fff8ef2f2153" released by "delete_volume" :: held 1.011s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Created reservations ['bf4eca78-33fa-48e6-916a-e5905a93047f', '06409020-2f53-4a9e-8fae-0918695f336d', '74d0e086-5de8-4498-9e41-db9438dd18a6', 'c860b347-1df5-486c-bf09-d7ccabe80703'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:42 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Deleted volume successfully.
Apr 06 16:54:42 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:42 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eaf4aec0-f026-47c6-9098-03c44c197115 tempest-VolumesTransfersV355Test-253463995 None] Lock "cinder-3fc9e817-eeb1-422b-a971-455453a5053e-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:42 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.494s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:42 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea
Apr 06 16:54:42 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:43 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:43 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Deleted volume successfully.
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c3a5f89b-d450-47ad-aff0-5df3c8c36746 tempest-VolumesListTestJSON-1801331087 None] Lock "cinder-ef82710a-6e6d-441b-9209-fff8ef2f2153-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:43 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:43 devstack sudo[87684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea
Apr 06 16:54:43 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:43 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14.3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-3f03deb6-3ac3-4dc4-85dc-330dbb9b20ea" released by "_delete_snapshot" :: held 2.041s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" released by "delete_snapshot" :: held 2.052s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:43 devstack cinder-volume[82421]: WARNING cinder.quota [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-781975367 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-781975367, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:54:43 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['cffc4b74-ccb2-4cd5-a462-968c8880e060', '9268fe8b-ee21-4eb5-992e-f36f12843dfb', 'f69f578d-18af-4425-81d6-a5bacb34a446', 'b930c913-868d-497c-9cd0-9ccb47d0fb3e'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:43 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fcc67f83-b1e1-40b0-a183-6ea5bec01143 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot e245c28a-d3c2-482f-89b7-2d7a9d2796e0: deleted successfully
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" acquired by "delete_volume" :: waited 0.041s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d66d04-e3d0-4aec-9a6e-0eeafa918fca]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:45 devstack sudo[87688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:45 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Flow 'volume_create_manager' (0f4a8a8b-80e2-459c-9dde-31245c90859a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218797ed-1737-417b-9b9b-322f1e8b062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218797ed-1737-417b-9b9b-322f1e8b062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658101546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6902f700-5a90-404e-bd6f-bf64096c3052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600cd58bd004f13a6bdf1e5877c4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:45Z,use_quota=True,user_id='2fd5bd82765d4ad99172ece5220e2f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c2a195-6b1e-4801-8873-14429f466087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c2a195-6b1e-4801-8873-14429f466087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f019ed4-c123-4bed-9e2d-1aa3b122b2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.image.glance [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Creating Keystone auth plugin from conf {{(pid=82421) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f019ed4-c123-4bed-9e2d-1aa3b122b2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6902f700-5a90-404e-bd6f-bf64096c3052', 'volume_name': 'volume-6902f700-5a90-404e-bd6f-bf64096c3052', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e0b111060>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad80aaaa-12c1-4f88-a1b9-ddb4027b7f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad80aaaa-12c1-4f88-a1b9-ddb4027b7f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fac6190-ddc5-44e1-a2d2-4836e4b582cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:45 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Volume 6902f700-5a90-404e-bd6f-bf64096c3052: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6902f700-5a90-404e-bd6f-bf64096c3052', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e0b111060>}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Trying to clone 6902f700-5a90-404e-bd6f-bf64096c3052 from image 765549bd-5564-4279-accf-2c50ecfd6b86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]). {{(pid=82421) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 06 16:54:45 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.608s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:45 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14
Apr 06 16:54:45 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 06 16:54:46 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Image download 20.69 MB at 20.69 MB/s
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092a443-4981-40f8-a9ef-1532584aa9a8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:46 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD
Apr 06 16:54:46 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:46 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" returned: 0 in 0.535s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-f21848da-1ae6-44ae-99f9-2c9e5c7c2c14" released by "delete_volume" :: held 1.197s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['266d36ce-87d0-487c-bf9f-c6ab77a11bca'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:46 devstack cinder-volume[82421]: WARNING cinder.db.sqlalchemy.api [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-781975367']
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['1d41a351-5eb3-4dd3-8421-ca5f3f615342', '79d96dfd-109c-4577-a2b7-e21386234f21', 'c3a729fd-ab2d-412f-b4cd-348ccbf592e6', 'cd110251-f88e-4966-9229-8ed6a4f643ab'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:46 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:54:46 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:46 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 is fetched for user 2fd5bd82765d4ad99172ece5220e2f04. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12d5fbf-406f-4e75-aaa3-e877b0766524]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:46 devstack sudo[87704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD
Apr 06 16:54:46 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:47 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.580s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:54:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-89433c46-45d5-43df-a593-de3ce7d2b9ad tempest-GroupSnapshotsTest-1528255746 None] Delete group completed successfully.
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Flow 'volume_create_manager' (f71e6987-ff26-47bd-b5a9-81e3ae2ccb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2894d3-9505-4931-a2e4-669537e8d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2894d3-9505-4931-a2e4-669537e8d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1922204128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff12a9d-36d1-4db8-9295-49feb1aa2ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f799d49db2c24ad49ff02fd22c5b5ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:47Z,use_quota=True,user_id='69d8af90e8064e0fa4627109d99c9056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50463c95-95ee-4368-86b3-1277f88695ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50463c95-95ee-4368-86b3-1277f88695ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375421f5-41db-40f1-a41b-81680d79afe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375421f5-41db-40f1-a41b-81680d79afe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'volume_name': 'volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2130c604-04fb-4ffd-9c38-97be327ec900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2130c604-04fb-4ffd-9c38-97be327ec900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78695de-a0d5-4f3e-87b6-edffb2fa99fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:47 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Volume 4ff12a9d-36d1-4db8-9295-49feb1aa2ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'volume_size': 1}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1922204128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff12a9d-36d1-4db8-9295-49feb1aa2ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f799d49db2c24ad49ff02fd22c5b5ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:47Z,use_quota=True,user_id='69d8af90e8064e0fa4627109d99c9056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Creating volume 4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:47 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:47 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 1073741824
Apr 06 16:54:47 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:47 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6e8a2ec4-9bf8-4f53-be5e-989a106e510e tempest-GroupSnapshotsTest-1528255746 None] Group tempest-GroupSnapshotsTest-Group-274332124: creating
Apr 06 16:54:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6e8a2ec4-9bf8-4f53-be5e-989a106e510e tempest-GroupSnapshotsTest-1528255746 None] Group tempest-GroupSnapshotsTest-Group-274332124: created successfully
Apr 06 16:54:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6e8a2ec4-9bf8-4f53-be5e-989a106e510e tempest-GroupSnapshotsTest-1528255746 None] Create group completed successfully.
Apr 06 16:54:47 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 1073741824" returned: 0 in 0.565s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:47 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:54:47 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:48 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658101546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6902f700-5a90-404e-bd6f-bf64096c3052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600cd58bd004f13a6bdf1e5877c4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:45Z,use_quota=True,user_id='2fd5bd82765d4ad99172ece5220e2f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Creating volume 6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:48 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78695de-a0d5-4f3e-87b6-edffb2fa99fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fae9e3-c4d9-4a1a-97f8-9cf42f9373b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:48 devstack sudo[87718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 1073741824
Apr 06 16:54:48 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:48 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Volume volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 (4ff12a9d-36d1-4db8-9295-49feb1aa2ba7): created successfully
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fae9e3-c4d9-4a1a-97f8-9cf42f9373b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Flow 'volume_create_manager' (f71e6987-ff26-47bd-b5a9-81e3ae2ccb87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:48 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f1449f24-9240-4231-9f39-4cc71b937450 tempest-VolumesCloneTest-2113147099 None] Created volume successfully.
Apr 06 16:54:48 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 1073741824" returned: 0 in 0.566s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:48 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:54:48 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:48 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (0c3b719b-f4b2-4491-b155-606e88ba2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4d6724-1337-41e5-a8dd-c4d7f47eb441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4d6724-1337-41e5-a8dd-c4d7f47eb441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1078842089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6647d6d-d07e-498c-9543-a6e3926ce42e,host='devstack@QuobyteHD#QuobyteHD',id=b0a16b4c-b79d-478f-a931-944debaa03ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:49Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c1b7561-c122-4dea-a5bd-a24dd8460a51),volume_type_id=2c1b7561-c122-4dea-a5bd-a24dd8460a51)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c73f8b-941b-4e60-b8dd-70c61105ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c73f8b-941b-4e60-b8dd-70c61105ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d495b41a-2726-4ae7-8000-889dc1d8c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d495b41a-2726-4ae7-8000-889dc1d8c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a16b4c-b79d-478f-a931-944debaa03ef', 'volume_name': 'volume-b0a16b4c-b79d-478f-a931-944debaa03ef', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb8c1e5-e74b-4b28-8bee-afb443c396c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb8c1e5-e74b-4b28-8bee-afb443c396c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c92b9f-a11a-47a9-af83-d251bce3693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Volume b0a16b4c-b79d-478f-a931-944debaa03ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a16b4c-b79d-478f-a931-944debaa03ef', 'volume_size': 1}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:49 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 0 in 0.527s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d6647d6d-d07e-498c-9543-a6e3926ce42e,created_at=2026-04-06T14:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1078842089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6647d6d-d07e-498c-9543-a6e3926ce42e,host='devstack@QuobyteHD#QuobyteHD',id=b0a16b4c-b79d-478f-a931-944debaa03ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:49Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c1b7561-c122-4dea-a5bd-a24dd8460a51),volume_type_id=2c1b7561-c122-4dea-a5bd-a24dd8460a51)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Creating volume b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:49 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Attempting download of 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume 6902f700-5a90-404e-bd6f-bf64096c3052. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 06 16:54:49 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef 1073741824
Apr 06 16:54:49 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04cd206-df71-40ed-a434-c41e15c3aaa3]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Flow 'volume_create_manager' (b5f5546e-c7b7-4a8e-bdea-c35c819ef4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a99fcaa-a013-4ce4-ac01-08fcdfd091b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a99fcaa-a013-4ce4-ac01-08fcdfd091b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-444887405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a1015-8c97-4946-b93b-b9b1d116b965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f799d49db2c24ad49ff02fd22c5b5ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=4ff12a9d-36d1-4db8-9295-49feb1aa2ba7,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:49Z,use_quota=True,user_id='69d8af90e8064e0fa4627109d99c9056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f1b660-fbd1-4ec9-a6d7-aef9acf6e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f1b660-fbd1-4ec9-a6d7-aef9acf6e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48c3f47-3412-44e7-b765-004346c51d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48c3f47-3412-44e7-b765-004346c51d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd2a1015-8c97-4946-b93b-b9b1d116b965', 'volume_name': 'volume-cd2a1015-8c97-4946-b93b-b9b1d116b965', 'volume_size': 2, 'source_volid': '4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e001a8e-9152-4b16-bb73-852dda040365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e001a8e-9152-4b16-bb73-852dda040365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1a5f91-8b20-46dd-a43a-fee23fdb44af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:49 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Volume cd2a1015-8c97-4946-b93b-b9b1d116b965: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd2a1015-8c97-4946-b93b-b9b1d116b965', 'volume_size': 2, 'source_volid': '4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'source_volstatus': 'available'}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:49 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb
Apr 06 16:54:49 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:49 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef 1073741824" returned: 0 in 0.577s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:49 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef
Apr 06 16:54:49 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:50 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb" returned: 0 in 0.588s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:50 devstack sudo[87737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb
Apr 06 16:54:50 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:50 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.744s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:50 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Cloning volume 4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 to volume cd2a1015-8c97-4946-b93b-b9b1d116b965
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c92b9f-a11a-47a9-af83-d251bce3693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a16b4c-b79d-478f-a931-944debaa03ef', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ad9d5-2bde-43a2-9e9f-a5336dc54eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:50 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Volume volume-b0a16b4c-b79d-478f-a931-944debaa03ef (b0a16b4c-b79d-478f-a931-944debaa03ef): created successfully
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ad9d5-2bde-43a2-9e9f-a5336dc54eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (0c3b719b-f4b2-4491-b155-606e88ba2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Creating offline snapshot fb903fa9-c93a-4103-b7d6-a6a9be419bc2 of volume 4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:54:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e6ce9257-3e6b-4b48-a146-f606394e1d59 tempest-GroupSnapshotsTest-1528255746 None] Created volume successfully.
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85bbfe6-82d2-47e2-88df-da29b9f2bf91]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:50 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:54:50 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:50 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb" returned: 1 in 0.487s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_j3o9wajb' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb7cd6-12a1-4f9c-a4ff-d33d09a13573]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:50 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD
Apr 06 16:54:50 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:50 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.526s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:50 devstack sudo[87749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 1G
Apr 06 16:54:50 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:51 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] 765549bd-5564-4279-accf-2c50ecfd6b86 was qcow2, converting to raw {{(pid=82421) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:51 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:54:51 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:51 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (30641e18-8a27-4b00-af04-e82bdab2b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4341bb5-ce34-4aa8-990c-22ff9f8904ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 1G" returned: 0 in 0.617s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:51 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2
Apr 06 16:54:51 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4341bb5-ce34-4aa8-990c-22ff9f8904ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-72337202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6647d6d-d07e-498c-9543-a6e3926ce42e,host='devstack@QuobyteHD#QuobyteHD',id=c2bad1c9-6521-4eb5-bdae-f283192248e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:51Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c1b7561-c122-4dea-a5bd-a24dd8460a51),volume_type_id=2c1b7561-c122-4dea-a5bd-a24dd8460a51)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7ae1b7-55ff-4e72-9475-1669bdbab2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7ae1b7-55ff-4e72-9475-1669bdbab2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bef3b14-2c64-4733-88e8-622cce24ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bef3b14-2c64-4733-88e8-622cce24ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bad1c9-6521-4eb5-bdae-f283192248e6', 'volume_name': 'volume-c2bad1c9-6521-4eb5-bdae-f283192248e6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb8206b-eeaa-414e-944f-d571077c8924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb8206b-eeaa-414e-944f-d571077c8924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e58265d-b073-4185-ac0e-03d6f7ece537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:51 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Volume c2bad1c9-6521-4eb5-bdae-f283192248e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bad1c9-6521-4eb5-bdae-f283192248e6', 'volume_size': 1}
Apr 06 16:54:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:52 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:52 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 is being set with open permissions: ugo+rw
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:52 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2
Apr 06 16:54:52 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:52 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 0 in 1.068s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_86aamrvzdevstack@QuobyteHD, size 112.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:54:52 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Converted 112.00 MB image at 104.70 MB/s
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:52 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 1G
Apr 06 16:54:52 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:52 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2" returned: 0 in 0.404s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:52 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info
Apr 06 16:54:52 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:52 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 1G" returned: 0 in 0.484s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a18d217-dd4d-4590-9b32-662006374945]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:52 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:54:52 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:52 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:52 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info is being set with open permissions: ugo+rw
Apr 06 16:54:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:52 devstack sudo[87782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info
Apr 06 16:54:52 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:53 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 0 in 0.514s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:53 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:54:53 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:53 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.info" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Acquiring lock "cinder-quobyte-cd2a1015-8c97-4946-b93b-b9b1d116b965" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-cd2a1015-8c97-4946-b93b-b9b1d116b965" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] snapshot: fb903fa9-c93a-4103-b7d6-a6a9be419bc2, volume: cd2a1015-8c97-4946-b93b-b9b1d116b965,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195a25d-d585-45f9-a53c-1e583c4dcc99]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:53 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2
Apr 06 16:54:53 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:53 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 1 in 0.505s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Downloaded image 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume 6902f700-5a90-404e-bd6f-bf64096c3052 successfully. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 for user 2fd5bd82765d4ad99172ece5220e2f04 is deleted. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Marking volume 6902f700-5a90-404e-bd6f-bf64096c3052 as bootable. {{(pid=82421) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Copying metadata from image 765549bd-5564-4279-accf-2c50ecfd6b86 to 6902f700-5a90-404e-bd6f-bf64096c3052. {{(pid=82421) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Creating volume glance metadata for volume 6902f700-5a90-404e-bd6f-bf64096c3052 backed by image 765549bd-5564-4279-accf-2c50ecfd6b86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82421) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fac6190-ddc5-44e1-a2d2-4836e4b582cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6902f700-5a90-404e-bd6f-bf64096c3052', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e0b111060>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb9c8ac-b447-4c2c-9a37-388a58034386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:53 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Volume volume-6902f700-5a90-404e-bd6f-bf64096c3052 (6902f700-5a90-404e-bd6f-bf64096c3052): created successfully
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb9c8ac-b447-4c2c-9a37-388a58034386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:53 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Flow 'volume_create_manager' (0f4a8a8b-80e2-459c-9dde-31245c90859a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-10955269-ace7-49dd-a893-b08cf077afda tempest-VolumesExtendTest-1713072628 None] Created volume successfully.
Apr 06 16:54:54 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2" returned: 0 in 0.598s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d0bbf-fbaf-4ec0-ae83-f7f9d05da4da]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:54 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:54:54 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:54 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.540s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:54 devstack sudo[87805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965
Apr 06 16:54:54 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:54 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (e0080e76-5990-4ef8-875e-b9c6ec1771df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996e9d49-6f21-482d-a876-652b2329c61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996e9d49-6f21-482d-a876-652b2329c61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570846892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538b67e9-7d2f-430e-a692-0ecfa664ae74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:55Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e00b88e-2084-4228-980e-67e12164ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e00b88e-2084-4228-980e-67e12164ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146bb59b-febf-4f40-ac88-6109c6f00dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146bb59b-febf-4f40-ac88-6109c6f00dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538b67e9-7d2f-430e-a692-0ecfa664ae74', 'volume_name': 'volume-538b67e9-7d2f-430e-a692-0ecfa664ae74', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b520b4e1-d230-402b-b344-93bd6b7f47f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b520b4e1-d230-402b-b344-93bd6b7f47f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd99a4-a328-4c96-9ff1-e62a266f4be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:55 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Volume 538b67e9-7d2f-430e-a692-0ecfa664ae74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538b67e9-7d2f-430e-a692-0ecfa664ae74', 'volume_size': 1}
Apr 06 16:54:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:56 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965" returned: 0 in 2.146s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:56 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91ff27-bfaa-4a74-967e-5db60bbf077f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:56 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:54:56 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:57 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.584s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:54:57 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Converted 1024.00 MB image at 476.94 MB/s
Apr 06 16:54:57 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 is being set with open permissions: ugo+rw
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:57 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965
Apr 06 16:54:57 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:57 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965" returned: 0 in 0.413s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-cd2a1015-8c97-4946-b93b-b9b1d116b965" released by "_copy_volume_from_snapshot" :: held 4.351s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Acquiring lock "cinder-quobyte-fb903fa9-c93a-4103-b7d6-a6a9be419bc2" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-fb903fa9-c93a-4103-b7d6-a6a9be419bc2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Deleting offline snapshot fb903fa9-c93a-4103-b7d6-a6a9be419bc2 of volume 4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] snapshot_file for this snap is: volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f81d2d-cd3c-40f4-ab24-fce1e8e90936]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:57 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2
Apr 06 16:54:57 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:58 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:54:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50a9eb-0f5b-4ba0-8ee1-6858046ee724]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:54:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:58 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:54:58 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:58 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:58 devstack sudo[87835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2
Apr 06 16:54:58 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:59 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:59 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2
Apr 06 16:54:59 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:59 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7.fb903fa9-c93a-4103-b7d6-a6a9be419bc2" returned: 0 in 0.422s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-fb903fa9-c93a-4103-b7d6-a6a9be419bc2" released by "_delete_snapshot" :: held 1.886s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.314s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.044s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d6647d6d-d07e-498c-9543-a6e3926ce42e,created_at=2026-04-06T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-72337202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d6647d6d-d07e-498c-9543-a6e3926ce42e,host='devstack@QuobyteHD#QuobyteHD',id=c2bad1c9-6521-4eb5-bdae-f283192248e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:51Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c1b7561-c122-4dea-a5bd-a24dd8460a51),volume_type_id=2c1b7561-c122-4dea-a5bd-a24dd8460a51)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Creating volume c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:54:59 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1a5f91-8b20-46dd-a43a-fee23fdb44af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2a1015-8c97-4946-b93b-b9b1d116b965', 'volume_size': 2, 'source_volid': '4ff12a9d-36d1-4db8-9295-49feb1aa2ba7', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2ca83b-7008-40e8-a88e-a605d0fd253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:54:59 devstack sudo[87843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 1073741824
Apr 06 16:54:59 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:54:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Volume volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 (cd2a1015-8c97-4946-b93b-b9b1d116b965): created successfully
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2ca83b-7008-40e8-a88e-a605d0fd253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:54:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Flow 'volume_create_manager' (b5f5546e-c7b7-4a8e-bdea-c35c819ef4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:54:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c640a64a-f6ce-44ba-a999-e230a799e47f tempest-VolumesCloneTest-2113147099 None] Created volume successfully.
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Acquiring lock "cinder-cd2a1015-8c97-4946-b93b-b9b1d116b965-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Lock "cinder-cd2a1015-8c97-4946-b93b-b9b1d116b965-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Acquiring lock "cinder-quobyte-cd2a1015-8c97-4946-b93b-b9b1d116b965" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-cd2a1015-8c97-4946-b93b-b9b1d116b965" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:00 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 1073741824" returned: 0 in 0.530s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3669ee21-54a0-4c63-b838-a14aa8e579c7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:00 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6
Apr 06 16:55:00 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:00 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965
Apr 06 16:55:00 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:00 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6" returned: 0 in 0.436s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.611s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e58265d-b073-4185-ac0e-03d6f7ece537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bad1c9-6521-4eb5-bdae-f283192248e6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb9f322-76ba-4bc6-a6e5-183282adccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:00 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Volume volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 (c2bad1c9-6521-4eb5-bdae-f283192248e6): created successfully
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb9f322-76ba-4bc6-a6e5-183282adccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:00 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (30641e18-8a27-4b00-af04-e82bdab2b068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0792649-a02b-4651-bea8-c94f8bbc2e3a]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6e78fd8c-743b-4e72-8d11-a5b5651c0786 tempest-GroupSnapshotsTest-1528255746 None] Created volume successfully.
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965" returned: 0 in 0.533s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:00 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965
Apr 06 16:55:00 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:00 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:55:00 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:01 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cd2a1015-8c97-4946-b93b-b9b1d116b965" returned: 0 in 0.394s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-cd2a1015-8c97-4946-b93b-b9b1d116b965" released by "delete_volume" :: held 0.959s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Created reservations ['45455943-271c-4012-8734-53f240e9e387', 'd9885024-3614-4258-8ce3-3eec2715d6bd', '4391602e-de9b-4867-bce7-8d220393a0bb', '77b84480-d3d8-4aef-ac5b-b40584b17de7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:01 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 0 in 0.462s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:01 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:55:01 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:01 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:01 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Acquiring lock "cinder-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Lock "cinder-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Acquiring lock "cinder-quobyte-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" acquired by "delete_volume" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[596ada11-f04b-4452-8284-fb82b6114062]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:01 devstack sudo[88010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:55:01 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b293512a-d0c0-4b22-9b4c-45cef84db012 tempest-GroupSnapshotsTest-1528255746 None] Update group completed successfully.
Apr 06 16:55:01 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Deleted volume successfully.
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-eed6d42d-4866-40d9-ade3-e9293001797e tempest-VolumesCloneTest-2113147099 None] Lock "cinder-cd2a1015-8c97-4946-b93b-b9b1d116b965-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:01 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 1 in 0.560s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 2G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 2G" returned: 0 in 0.049s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.114s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.700s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570846892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538b67e9-7d2f-430e-a692-0ecfa664ae74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:54:55Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Creating volume 538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:01 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:01 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 1073741824
Apr 06 16:55:01 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9ba8dc19-9700-4764-906d-3f62f592fb9d tempest-VolumesExtendTest-1713072628 None] Extend volume completed successfully.
Apr 06 16:55:01 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.552s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:02 devstack sudo[88024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7
Apr 06 16:55:02 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:02 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 1073741824" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:02 devstack sudo[88030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74
Apr 06 16:55:02 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:02 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Lock "cinder-quobyte-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7" released by "delete_volume" :: held 1.006s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Created reservations ['bb950489-a309-41e9-bec8-8d298481184d', 'debbcf74-1706-443a-8649-39a1837cd03a', 'eeaa716e-1c54-4290-8b93-0a22c9e7f874', '17123681-e895-4faf-80f8-a57deff46ce4'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:02 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:02 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2c610ca8-85e7-46fa-8250-7322217015be tempest-GroupSnapshotsTest-1528255746 None] Update group completed successfully.
Apr 06 16:55:02 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74" returned: 0 in 0.453s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd99a4-a328-4c96-9ff1-e62a266f4be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538b67e9-7d2f-430e-a692-0ecfa664ae74', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd82f27-a67b-44f2-a400-2aabc12c0691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Volume volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 (538b67e9-7d2f-430e-a692-0ecfa664ae74): created successfully
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd82f27-a67b-44f2-a400-2aabc12c0691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (e0080e76-5990-4ef8-875e-b9c6ec1771df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1af1010e-be36-49aa-93fc-a33e611b426d tempest-VolumesSnapshotTestJSON-1070078568 None] Created volume successfully.
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-6902f700-5a90-404e-bd6f-bf64096c3052-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Lock "cinder-6902f700-5a90-404e-bd6f-bf64096c3052-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-quobyte-6902f700-5a90-404e-bd6f-bf64096c3052" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-6902f700-5a90-404e-bd6f-bf64096c3052" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887696d-7afd-412f-a021-06c317a1b252]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:02 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Deleted volume successfully.
Apr 06 16:55:03 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:55:03 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33aa3678-6c15-423e-bc5e-b469cad0e945 tempest-VolumesCloneTest-2113147099 None] Lock "cinder-4ff12a9d-36d1-4db8-9295-49feb1aa2ba7-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:03 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:03 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:55:03 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:03 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:03 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Creating offline snapshot b4263513-b3f8-4c0f-a5db-65462689292c of volume 538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73eb216-6f1d-4afc-96ce-6f9248ab6bfa]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f2d107cb-49f5-4dce-bbf6-8785ede39a59 tempest-GroupSnapshotsTest-1528255746 None] Update group completed successfully.
Apr 06 16:55:03 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74
Apr 06 16:55:03 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:03 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 1 in 0.583s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:55:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:04 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052
Apr 06 16:55:04 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:04 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.550s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:04 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74" returned: 0 in 0.662s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:04 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c 1G
Apr 06 16:55:04 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:04 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-6902f700-5a90-404e-bd6f-bf64096c3052" returned: 0 in 0.542s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-6902f700-5a90-404e-bd6f-bf64096c3052" released by "delete_volume" :: held 1.617s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Created reservations ['be1f335b-5a2d-488e-b00e-28d53befeb1e', '263774ec-5f84-444f-a9bc-316f10318cfd', 'dd549886-f9dd-4a5f-a4a1-0a5c2cb68fbc', 'd1e19efc-383e-4fe8-b24f-c69ce86ac697'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:04 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:04 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:05 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c 1G" returned: 0 in 0.563s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:05 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:05 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c2876545-78ff-458c-934d-917270aff06a tempest-GroupSnapshotsTest-1528255746 None] Update group completed successfully.
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.495s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:05 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Deleted volume successfully.
Apr 06 16:55:05 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c
Apr 06 16:55:05 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-77c62a6f-4896-48af-a6bc-9b76f190339b tempest-VolumesExtendTest-1713072628 None] Lock "cinder-6902f700-5a90-404e-bd6f-bf64096c3052-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Flow 'volume_create_manager' (1661a987-a2f6-4af0-9044-32b956c8b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d5c037-bc88-4839-95aa-bebc500b2b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d5c037-bc88-4839-95aa-bebc500b2b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1536911207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dd9e6f-5ba8-433f-abe0-594977c6ab4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600cd58bd004f13a6bdf1e5877c4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:05Z,use_quota=True,user_id='2fd5bd82765d4ad99172ece5220e2f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b798cee0-4226-4685-9b0c-f688707b9f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b798cee0-4226-4685-9b0c-f688707b9f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ec3fed-6eb2-4773-a45b-8700dbc5086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ec3fed-6eb2-4773-a45b-8700dbc5086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dd9e6f-5ba8-433f-abe0-594977c6ab4e', 'volume_name': 'volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10352cc2-9f87-43e8-af04-fa995514cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10352cc2-9f87-43e8-af04-fa995514cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a672d81a-2e8b-423f-bbf8-db835bf06136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Volume 65dd9e6f-5ba8-433f-abe0-594977c6ab4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e', 'volume_size': 1}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Flow 'volume_create_manager' (264c1ce4-aee1-4120-9221-96dd33dd1a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd03b801-2263-4dd6-9a60-2ae768a64e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd03b801-2263-4dd6-9a60-2ae768a64e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa50a330-7ed3-40f0-96b4-2a505a2f451d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd85c518bfb436ba18c7ca95934e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:05Z,use_quota=True,user_id='4566a360e3ca484fb0d21e653810e1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c34f0d1-ba7f-47e6-b049-fd8d33f43b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c34f0d1-ba7f-47e6-b049-fd8d33f43b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489d65b8-7c66-4628-87ec-2518843f2976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489d65b8-7c66-4628-87ec-2518843f2976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa50a330-7ed3-40f0-96b4-2a505a2f451d', 'volume_name': 'volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8389207f-8122-44f5-8870-d6d8b99ef42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8389207f-8122-44f5-8870-d6d8b99ef42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8c9299-0604-43eb-b6a1-49a3b25404b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:05 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Volume fa50a330-7ed3-40f0-96b4-2a505a2f451d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d', 'volume_size': 1}
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:05 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c" returned: 0 in 0.531s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:05 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c is being set with open permissions: ugo+rw
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:05 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c
Apr 06 16:55:05 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:05 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:06 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info
Apr 06 16:55:06 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] GroupSnapshot 131da159-1965-4b36-87cc-bea55ae9dc23: creating.
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Group snapshot 131da159-1965-4b36-87cc-bea55ae9dc23: creating. {{(pid=82421) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:06 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:06 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info is being set with open permissions: ugo+rw
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:06 devstack sudo[88076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info
Apr 06 16:55:06 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:06 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.info" returned: 0 in 0.405s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.021s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1536911207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dd9e6f-5ba8-433f-abe0-594977c6ab4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9600cd58bd004f13a6bdf1e5877c4fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:05Z,use_quota=True,user_id='2fd5bd82765d4ad99172ece5220e2f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Creating volume 65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:06 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:06 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e 1073741824
Apr 06 16:55:06 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f6b1fda5-f484-4745-ac8b-2878bab24f01 tempest-VolumesSnapshotTestJSON-1070078568 None] Create snapshot completed successfully
Apr 06 16:55:07 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e 1073741824" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:07 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e
Apr 06 16:55:07 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:07 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.153s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa50a330-7ed3-40f0-96b4-2a505a2f451d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd85c518bfb436ba18c7ca95934e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:05Z,use_quota=True,user_id='4566a360e3ca484fb0d21e653810e1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Creating volume fa50a330-7ed3-40f0-96b4-2a505a2f451d {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:07 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a672d81a-2e8b-423f-bbf8-db835bf06136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:07 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d 1073741824
Apr 06 16:55:07 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915f7f1a-e144-4c55-8454-9a367db2a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:07 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Volume volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e (65dd9e6f-5ba8-433f-abe0-594977c6ab4e): created successfully
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915f7f1a-e144-4c55-8454-9a367db2a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Flow 'volume_create_manager' (1661a987-a2f6-4af0-9044-32b956c8b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:07 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d618a6fe-1add-456f-8b6f-b6e34c93a03e tempest-VolumesExtendTest-1713072628 None] Created volume successfully.
Apr 06 16:55:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-b4263513-b3f8-4c0f-a5db-65462689292c-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-b4263513-b3f8-4c0f-a5db-65462689292c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-538b67e9-7d2f-430e-a692-0ecfa664ae74" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-538b67e9-7d2f-430e-a692-0ecfa664ae74" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-b4263513-b3f8-4c0f-a5db-65462689292c" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-b4263513-b3f8-4c0f-a5db-65462689292c" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Deleting offline snapshot b4263513-b3f8-4c0f-a5db-65462689292c of volume 538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] snapshot_file for this snap is: volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45e479-0bec-40bd-9aa3-3bf019fee700]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:08 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c
Apr 06 16:55:08 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:08 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d 1073741824" returned: 0 in 0.502s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:08 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d
Apr 06 16:55:08 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:08 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c" returned: 0 in 0.514s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-538b67e9-7d2f-430e-a692-0ecfa664ae74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6a6551-d7a9-4c40-a88d-4ae1f979cc4c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:08 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d" returned: 0 in 0.429s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:08 devstack sudo[88100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74
Apr 06 16:55:08 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.354s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8c9299-0604-43eb-b6a1-49a3b25404b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d9995a-6527-4c49-9671-f43e3542f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:08 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Volume volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d (fa50a330-7ed3-40f0-96b4-2a505a2f451d): created successfully
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d9995a-6527-4c49-9671-f43e3542f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Flow 'volume_create_manager' (264c1ce4-aee1-4120-9221-96dd33dd1a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Creating offline snapshot da0b9c02-d5de-4d35-a65d-63b04d13882a of volume c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c81e18bd-1fde-4c5b-b63a-2e819c64097f tempest-CinderUnicodeTest-257461790 None] Created volume successfully.
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4cf059-6cc0-4650-bac8-202164553d70]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:08 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6
Apr 06 16:55:08 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:09 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:09 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c
Apr 06 16:55:09 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:09 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:09 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a 1G
Apr 06 16:55:09 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:09 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:09 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c
Apr 06 16:55:09 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:09 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a 1G" returned: 0 in 0.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:09 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a
Apr 06 16:55:09 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:09 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74.b4263513-b3f8-4c0f-a5db-65462689292c" returned: 0 in 0.409s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-b4263513-b3f8-4c0f-a5db-65462689292c" released by "_delete_snapshot" :: held 1.933s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:09 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-538b67e9-7d2f-430e-a692-0ecfa664ae74" released by "delete_snapshot" :: held 1.948s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Flow 'volume_create_manager' (296c310b-1393-4427-8b6b-f24b69a06325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2596d7-aae0-46f5-8989-af51d7058801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2596d7-aae0-46f5-8989-af51d7058801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1660676145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd85c518bfb436ba18c7ca95934e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:10Z,use_quota=True,user_id='4566a360e3ca484fb0d21e653810e1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdea57c-10df-4fae-88ef-75ff9e6cbb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdea57c-10df-4fae-88ef-75ff9e6cbb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ebb58c-b06e-4e28-b043-4fcc26a4672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ebb58c-b06e-4e28-b043-4fcc26a4672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0', 'volume_name': 'volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fec3ec6-4a47-4db6-8fdf-d17cd118d808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fec3ec6-4a47-4db6-8fdf-d17cd118d808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:10 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec4ceb2-46ab-4a53-b6a7-13416434dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Volume 7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0', 'volume_size': 1}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:10 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:10 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a
Apr 06 16:55:10 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['69fa4d2e-97ca-4b66-8b3b-524302826bc3', '8e3d10ae-d39b-4f01-9997-2d07cef88276', '8cf80756-4abf-4a31-91e7-c0e27c31c1ed', '3b1783ac-24c7-465d-a8c6-47b928826107'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Delete snapshot completed successfully.
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dd256fe7-5c00-41d8-ad5c-259bd5c8a55c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-b4263513-b3f8-4c0f-a5db-65462689292c-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:10 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a" returned: 0 in 0.388s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:10 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info
Apr 06 16:55:10 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:10 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:10 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:55:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:10 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info
Apr 06 16:55:10 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:11 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.info" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Creating offline snapshot e9be8542-a683-4ee8-9969-e86e4c2a721f of volume b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866b5ea-4b63-4515-8ccc-ce481911ecce]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (1f64399b-5246-4068-bacc-8e51c590830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fc2f11-4e46-4b23-a6b7-c40777bc3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5fc2f11-4e46-4b23-a6b7-c40777bc3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2044931730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b3f2df-23ff-4457-af78-6ff5b858bdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:11Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:11 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef
Apr 06 16:55:11 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c466c1f-388f-4eff-8a79-17bdce265f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c466c1f-388f-4eff-8a79-17bdce265f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc490c50-d43e-45b5-ac81-6345209b781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc490c50-d43e-45b5-ac81-6345209b781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b3f2df-23ff-4457-af78-6ff5b858bdd6', 'volume_name': 'volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd599817-7d8b-45b7-ac5d-6f627c54414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd599817-7d8b-45b7-ac5d-6f627c54414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9a6166-dbf7-4a68-b086-765245c70625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:11 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume d1b3f2df-23ff-4457-af78-6ff5b858bdd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6', 'volume_size': 1}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:11 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef" returned: 0 in 0.458s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:11 devstack sudo[88142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f 1G
Apr 06 16:55:11 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:12 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f 1G" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0a16b4c-b79d-478f-a931-944debaa03ef -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:12 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0a16b4c-b79d-478f-a931-944debaa03ef -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f
Apr 06 16:55:12 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:12 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0a16b4c-b79d-478f-a931-944debaa03ef -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f" returned: 0 in 0.433s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:12 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:55:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:12 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f
Apr 06 16:55:12 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:13 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:13 devstack sudo[88162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info
Apr 06 16:55:13 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:13 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info" returned: 0 in 0.400s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:13 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:13 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info
Apr 06 16:55:13 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:13 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.info" returned: 0 in 0.395s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.845s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1660676145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd85c518bfb436ba18c7ca95934e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:10Z,use_quota=True,user_id='4566a360e3ca484fb0d21e653810e1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Creating volume 7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:13 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:13 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 1073741824
Apr 06 16:55:13 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5732107d-2b4c-4ec1-8f00-9012de9ec946 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 131da159-1965-4b36-87cc-bea55ae9dc23: created successfully
Apr 06 16:55:14 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 1073741824" returned: 0 in 0.479s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:14 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0
Apr 06 16:55:14 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 131da159-1965-4b36-87cc-bea55ae9dc23: deleting
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 131da159-1965-4b36-87cc-bea55ae9dc23: deleting {{(pid=82421) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-c2bad1c9-6521-4eb5-bdae-f283192248e6" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-c2bad1c9-6521-4eb5-bdae-f283192248e6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-da0b9c02-d5de-4d35-a65d-63b04d13882a" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-da0b9c02-d5de-4d35-a65d-63b04d13882a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Deleting offline snapshot da0b9c02-d5de-4d35-a65d-63b04d13882a of volume c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] snapshot_file for this snap is: volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b974582f-d699-413e-8a2e-5ab085fb1485]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:14 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a
Apr 06 16:55:14 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:14 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" returned: 0 in 0.436s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.248s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec4ceb2-46ab-4a53-b6a7-13416434dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8171b7-a7e0-465b-ab15-e34bf793c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:14 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Volume volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 (7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0): created successfully
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8171b7-a7e0-465b-ab15-e34bf793c089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Flow 'volume_create_manager' (296c310b-1393-4427-8b6b-f24b69a06325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Creating offline snapshot 3d04e966-0079-4123-b4ff-1afd85a8b330 of volume 65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-275ddb83-efb1-4c68-bb22-e0f416b3e5cf tempest-CinderUnicodeTest-257461790 None] Created volume successfully.
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9ab66c-802f-485d-bcae-04f64997820f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:15 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e
Apr 06 16:55:15 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:15 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2bad1c9-6521-4eb5-bdae-f283192248e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2077fd9-f9ef-4a78-9d4c-adcac7f45c72]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:15 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6
Apr 06 16:55:15 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:15 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" returned: 0 in 0.501s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:15 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 1G
Apr 06 16:55:15 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:15 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6" returned: 0 in 0.474s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:15 devstack sudo[88193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a
Apr 06 16:55:15 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:16 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 1G" returned: 0 in 0.556s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:16 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330
Apr 06 16:55:16 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:16 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:16 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a
Apr 06 16:55:16 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:16 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330" returned: 0 in 0.429s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:16 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 is being set with open permissions: ugo+rw
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:16 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330
Apr 06 16:55:16 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:16 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6.da0b9c02-d5de-4d35-a65d-63b04d13882a" returned: 0 in 0.401s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-da0b9c02-d5de-4d35-a65d-63b04d13882a" released by "_delete_snapshot" :: held 1.869s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-c2bad1c9-6521-4eb5-bdae-f283192248e6" released by "delete_snapshot" :: held 1.882s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-b0a16b4c-b79d-478f-a931-944debaa03ef" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b0a16b4c-b79d-478f-a931-944debaa03ef" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-e9be8542-a683-4ee8-9969-e86e4c2a721f" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-e9be8542-a683-4ee8-9969-e86e4c2a721f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Deleting offline snapshot e9be8542-a683-4ee8-9969-e86e4c2a721f of volume b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] snapshot_file for this snap is: volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d6252-5a54-4a52-a34e-bac73f1dd9cd]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:16 devstack sudo[88212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f
Apr 06 16:55:16 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:16 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:16 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info
Apr 06 16:55:16 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:17 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f" returned: 0 in 0.475s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0a16b4c-b79d-478f-a931-944debaa03ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d85bb-53cf-4842-9faa-5422998546a8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:17 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef
Apr 06 16:55:17 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:17 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info" returned: 0 in 0.433s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:17 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info is being set with open permissions: ugo+rw
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:17 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info
Apr 06 16:55:17 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:17 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef" returned: 0 in 0.457s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:17 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f
Apr 06 16:55:17 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:17 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.info" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.258s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2044931730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b3f2df-23ff-4457-af78-6ff5b858bdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:11Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Creating volume d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:17 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:17 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 1073741824
Apr 06 16:55:17 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2e36d7ea-d266-4346-a9d8-881406603e22 tempest-VolumesExtendTest-1713072628 None] Create snapshot completed successfully
Apr 06 16:55:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:18 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:18 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f
Apr 06 16:55:18 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:18 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 1073741824" returned: 0 in 0.515s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:18 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:18 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:18 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef.e9be8542-a683-4ee8-9969-e86e4c2a721f" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-e9be8542-a683-4ee8-9969-e86e4c2a721f" released by "_delete_snapshot" :: held 1.894s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b0a16b4c-b79d-478f-a931-944debaa03ef" released by "delete_snapshot" :: held 1.907s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:18 devstack cinder-volume[82421]: WARNING cinder.quota [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2040159162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2040159162, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:55:18 devstack cinder-volume[82421]: WARNING cinder.quota [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2040159162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2040159162, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['bc3f2ddd-c05c-4186-a222-0c21ea91c424', 'f75d1d1d-767b-416d-a4bd-9a17bd9b8780', '452c4c9b-eabe-4969-a2fb-093e1209df99', 'b6647ec5-327c-4332-a166-81ce2c0bea91'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['281c20c6-d013-4227-b5d3-be17aa805ff8', '61287b8c-8cb2-4368-8b69-07a050dc9461', '108135e2-03a3-44e5-9a87-ad715ca4d9ff', '3156c492-66ec-4c98-ab31-e70786cfd56b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:18 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.220s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:18 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-131b8aea-a1f7-462a-841c-9189e496089e tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 131da159-1965-4b36-87cc-bea55ae9dc23: deleted successfully
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9a6166-dbf7-4a68-b086-765245c70625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e245e1c-e625-4cc0-9353-641433b7359b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Creating offline snapshot 129bbc34-d74a-4841-b773-66756a70d65b of volume 7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 (d1b3f2df-23ff-4457-af78-6ff5b858bdd6): created successfully
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e245e1c-e625-4cc0-9353-641433b7359b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (1f64399b-5246-4068-bacc-8e51c590830c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d372440-a052-459e-8fb5-a09d17e8219e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:18 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c899ab0e-203b-4b99-9f4d-f1a369b786e5 tempest-VolumesSnapshotTestJSON-1070078568 None] Created volume successfully.
Apr 06 16:55:18 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0
Apr 06 16:55:18 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-b0a16b4c-b79d-478f-a931-944debaa03ef" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b0a16b4c-b79d-478f-a931-944debaa03ef" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab198749-c16c-4f1e-b297-47b3899ef7d7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:19 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:19 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b 1G
Apr 06 16:55:19 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:19 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef
Apr 06 16:55:19 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:19 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef" returned: 0 in 0.499s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:19 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:19 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef
Apr 06 16:55:19 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b 1G" returned: 0 in 0.484s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:19 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b
Apr 06 16:55:19 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:20 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b0a16b4c-b79d-478f-a931-944debaa03ef" returned: 0 in 0.403s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-b0a16b4c-b79d-478f-a931-944debaa03ef" released by "delete_volume" :: held 0.940s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-c2bad1c9-6521-4eb5-bdae-f283192248e6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-c2bad1c9-6521-4eb5-bdae-f283192248e6" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d44a32e-3d84-4ef2-a8e1-cd50d41f991c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:20 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b" returned: 0 in 0.463s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:20 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b is being set with open permissions: ugo+rw
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:20 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b
Apr 06 16:55:20 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:20 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6
Apr 06 16:55:20 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:20 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6" returned: 0 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:20 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b" returned: 0 in 0.422s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:20 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6
Apr 06 16:55:20 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:20 devstack sudo[88398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info
Apr 06 16:55:20 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:20 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c2bad1c9-6521-4eb5-bdae-f283192248e6" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-c2bad1c9-6521-4eb5-bdae-f283192248e6" released by "delete_volume" :: held 0.885s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:21 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:21 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info is being set with open permissions: ugo+rw
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['01f9aba8-4349-4ae0-856b-740bd290df97'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:21 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info
Apr 06 16:55:21 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:21 devstack cinder-volume[82421]: WARNING cinder.quota [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2040159162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2040159162, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['88abe6e5-f7aa-4460-8822-6d34b13640f4', 'fa4229aa-9bc8-47cd-a84d-d43d06364ae0', 'f08f9690-4785-4a38-abca-b0e6bebb6af2', '50ba44a7-0785-4f80-9582-e90b40a764ad'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['41527484-9985-4537-bab5-b40d532cf325', '01a91027-61d3-40cf-9c82-8f1127b1e4a4', '782e9f2e-ba74-4e97-ae62-b820e7d47683', 'baac0ca6-5ca2-4b41-aa69-31c9dfad0f66'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:21 devstack sudo[88404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:21 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:21 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.info" returned: 0 in 0.417s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.518s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bc3e59-183a-4acf-bc01-2a67e33d0818]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e24838ee-b2d5-432b-9d43-c0fd5bcb7807 tempest-CinderUnicodeTest-257461790 None] Create snapshot completed successfully
Apr 06 16:55:21 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e
Apr 06 16:55:21 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c8c58804-cc69-40f9-8083-c84a606c49a4 tempest-GroupSnapshotsTest-1528255746 None] Group tempest-GroupSnapshotsTest-Group-825867086: creating
Apr 06 16:55:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c8c58804-cc69-40f9-8083-c84a606c49a4 tempest-GroupSnapshotsTest-1528255746 None] Group tempest-GroupSnapshotsTest-Group-825867086: created successfully
Apr 06 16:55:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c8c58804-cc69-40f9-8083-c84a606c49a4 tempest-GroupSnapshotsTest-1528255746 None] Create group completed successfully.
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-129bbc34-d74a-4841-b773-66756a70d65b-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:21 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Lock "cinder-129bbc34-d74a-4841-b773-66756a70d65b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-quobyte-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.498s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3fe4ab4d-9a5b-4c36-94d5-6fe856d2a7e9 tempest-GroupSnapshotsTest-1528255746 None] Delete group completed successfully.
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-quobyte-129bbc34-d74a-4841-b773-66756a70d65b" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-129bbc34-d74a-4841-b773-66756a70d65b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Deleting offline snapshot 129bbc34-d74a-4841-b773-66756a70d65b of volume 7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] snapshot_file for this snap is: volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f48db8-3243-4298-9ea1-ac23cff86b03]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:21 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b
Apr 06 16:55:21 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:21 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" returned: 0 in 0.470s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 2G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 2G" returned: 0 in 0.077s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.571s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.113s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:INSERT=74,cinder:SELECT=199,cinder:UPDATE=213,cinder:DELETE=16 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=203,cinder:INSERT=41,cinder:UPDATE=228,cinder:DELETE=13 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Creating offline snapshot 70e594c1-1ed6-4309-bdbc-fb6562475045 of volume d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a87a1f-5836-4825-8e7d-778823999694]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b7ac332f-5dda-44e1-a096-3d18e74f0f1f tempest-VolumesExtendTest-1713072628 None] Extend volume completed successfully.
Apr 06 16:55:22 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:22 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:22 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b" returned: 0 in 0.479s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04104304-fcad-4c4b-bc80-b576a333d1a9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-3d04e966-0079-4123-b4ff-1afd85a8b330-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-3d04e966-0079-4123-b4ff-1afd85a8b330-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-quobyte-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-quobyte-3d04e966-0079-4123-b4ff-1afd85a8b330" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-3d04e966-0079-4123-b4ff-1afd85a8b330" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Deleting offline snapshot 3d04e966-0079-4123-b4ff-1afd85a8b330 of volume 65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] snapshot_file for this snap is: volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba93fc6-c138-49a7-9a4f-405c7c07fab6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0
Apr 06 16:55:22 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:22 devstack sudo[88424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330
Apr 06 16:55:22 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:22 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 1G
Apr 06 16:55:22 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:22 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b
Apr 06 16:55:22 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:22 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5529faf-d8f7-4fe3-addf-f763ef00c608]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (9c4c0eef-0ac5-4c87-a197-31a6e6e38126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c59b91-beb9-40ea-899b-273013de416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:22 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e
Apr 06 16:55:22 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c59b91-beb9-40ea-899b-273013de416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1334557506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6bd5f89f-2d8a-4b3a-8282-09e9c0870c7b,host='devstack@QuobyteHD#QuobyteHD',id=5362c172-5e8c-4213-9214-b17a70eaa5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:23Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07dc1bd9-35e6-45e8-97ae-bc78d528dbb2),volume_type_id=07dc1bd9-35e6-45e8-97ae-bc78d528dbb2)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd3389d-62aa-4f6e-a97c-0f3f8461a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd3389d-62aa-4f6e-a97c-0f3f8461a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a324968c-9363-4f3a-94ce-5b56840f4dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a324968c-9363-4f3a-94ce-5b56840f4dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5362c172-5e8c-4213-9214-b17a70eaa5ef', 'volume_name': 'volume-5362c172-5e8c-4213-9214-b17a70eaa5ef', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c856f895-b3a3-4cd2-9eb2-f70a3b9a9626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c856f895-b3a3-4cd2-9eb2-f70a3b9a9626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f792cef-71da-4007-9706-a239b22e82b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Volume 5362c172-5e8c-4213-9214-b17a70eaa5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5362c172-5e8c-4213-9214-b17a70eaa5ef', 'volume_size': 1}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:23 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 1G" returned: 0 in 0.572s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:23 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045
Apr 06 16:55:23 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:23 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b" returned: 0 in 0.515s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:23 devstack sudo[88453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b
Apr 06 16:55:23 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:23 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" returned: 0 in 0.558s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:23 devstack sudo[88456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330
Apr 06 16:55:23 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:23 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045" returned: 0 in 0.433s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:23 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 is being set with open permissions: ugo+rw
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:23 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045
Apr 06 16:55:23 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:23 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0.129bbc34-d74a-4841-b773-66756a70d65b" returned: 0 in 0.408s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-129bbc34-d74a-4841-b773-66756a70d65b" released by "_delete_snapshot" :: held 1.985s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" released by "delete_snapshot" :: held 1.997s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Created reservations ['252ee367-70a5-4e5c-8354-e294f86e0c03', '1b4318ee-6d52-4a19-aa54-ae0dd7d9b25f', '2e8dd280-a351-4325-8e94-e95cfdf6447d', 'cb307955-15f0-4709-9eaf-c5d75c56d355'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:23 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Delete snapshot completed successfully.
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4e2fd04-ed7b-4794-add9-7ca868fef43e tempest-CinderUnicodeTest-257461790 None] Lock "cinder-129bbc34-d74a-4841-b773-66756a70d65b-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:23 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330" returned: 0 in 0.482s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:23 devstack sudo[88467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330
Apr 06 16:55:23 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:23 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:24 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info
Apr 06 16:55:24 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:24 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e.3d04e966-0079-4123-b4ff-1afd85a8b330" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-3d04e966-0079-4123-b4ff-1afd85a8b330" released by "_delete_snapshot" :: held 1.980s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" released by "delete_snapshot" :: held 1.996s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Created reservations ['98a3bb75-8fc3-4d9c-9926-35b003f20ffd', '168e50ea-4c78-429c-be23-4bcc0bec020d', 'eb31ed00-f924-4ad5-8b25-cfd6ca3aa18b', '7692008a-441d-45df-b2d2-c5e6d9b2fbf4'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Delete snapshot completed successfully.
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-91208377-c8f1-4cdf-ad54-97635129eea4 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-3d04e966-0079-4123-b4ff-1afd85a8b330-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:24 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-65dd9e6f-5ba8-433f-abe0-594977c6ab4e-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info" returned: 0 in 0.464s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:24 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info is being set with open permissions: ugo+rw
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-65dd9e6f-5ba8-433f-abe0-594977c6ab4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:24 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info
Apr 06 16:55:24 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "cinder-quobyte-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d9707a-defb-48e0-8256-40b9dabd6bc2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:24 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e
Apr 06 16:55:24 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:24 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-quobyte-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.info" returned: 0 in 0.424s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6bd5f89f-2d8a-4b3a-8282-09e9c0870c7b,created_at=2026-04-06T14:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1334557506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6bd5f89f-2d8a-4b3a-8282-09e9c0870c7b,host='devstack@QuobyteHD#QuobyteHD',id=5362c172-5e8c-4213-9214-b17a70eaa5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b4b610170942539af58e004a6a8ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:23Z,use_quota=True,user_id='52055f4eaf9446e7aa6d4c16775ecf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07dc1bd9-35e6-45e8-97ae-bc78d528dbb2),volume_type_id=07dc1bd9-35e6-45e8-97ae-bc78d528dbb2)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Creating volume 5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:24 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:24 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef 1073741824
Apr 06 16:55:24 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" acquired by "delete_volume" :: waited 0.061s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6fdde7-8ed6-41e0-a62e-d4dcbd4169f8]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d364f8e9-b3cd-4fd3-9937-39b468c05649 tempest-VolumesSnapshotTestJSON-1070078568 None] Create snapshot completed successfully
Apr 06 16:55:25 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" returned: 0 in 0.475s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:25 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0
Apr 06 16:55:25 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:25 devstack sudo[88485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e
Apr 06 16:55:25 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (106c8f9a-fd79-4826-b843-ee9a37f164d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2515f35-75d2-42f3-8bab-20fcc6d3c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2515f35-75d2-42f3-8bab-20fcc6d3c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-275390846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feda327-b080-45e0-91e2-b1ac07015a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=70e594c1-1ed6-4309-bdbc-fb6562475045,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:25Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:25 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d509ab-8b9b-45f0-bfdc-ed6953458bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d509ab-8b9b-45f0-bfdc-ed6953458bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cf0550-ddb6-4c59-adb7-878f9bbc754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cf0550-ddb6-4c59-adb7-878f9bbc754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7feda327-b080-45e0-91e2-b1ac07015a7e', 'volume_name': 'volume-7feda327-b080-45e0-91e2-b1ac07015a7e', 'volume_size': 2, 'snapshot_id': '70e594c1-1ed6-4309-bdbc-fb6562475045'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053717d8-945f-4df2-ba95-969ad10d646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053717d8-945f-4df2-ba95-969ad10d646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72663299-5966-4626-bc49-1c0dd71a6029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume 7feda327-b080-45e0-91e2-b1ac07015a7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7feda327-b080-45e0-91e2-b1ac07015a7e', 'volume_size': 2, 'snapshot_id': '70e594c1-1ed6-4309-bdbc-fb6562475045'}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:25 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" returned: 0 in 0.496s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef 1073741824" returned: 0 in 0.591s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-quobyte-65dd9e6f-5ba8-433f-abe0-594977c6ab4e" released by "delete_volume" :: held 1.004s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:25 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" returned: 0 in 0.595s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:25 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef
Apr 06 16:55:25 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Created reservations ['fe67f08b-6075-4ac7-a691-7ade14a2fc9a', '9748cf84-20b7-4209-8511-ff29c0807be1', '897144bc-0b76-438b-9774-ac9a8b24b87a', '1da12a80-b516-49d5-ab31-ed373be1e0af'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:25 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0
Apr 06 16:55:25 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:25 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:25 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:25 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef" returned: 0 in 0.392s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.438s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-70e594c1-1ed6-4309-bdbc-fb6562475045-7feda327-b080-45e0-91e2-b1ac07015a7e" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:25 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f792cef-71da-4007-9706-a239b22e82b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5362c172-5e8c-4213-9214-b17a70eaa5ef', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d0dfb-8468-4658-9821-ba4949c1bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-70e594c1-1ed6-4309-bdbc-fb6562475045-7feda327-b080-45e0-91e2-b1ac07015a7e" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Creating volume 7feda327-b080-45e0-91e2-b1ac07015a7e from snapshot 70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-7feda327-b080-45e0-91e2-b1ac07015a7e" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0" released by "delete_volume" :: held 1.047s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Volume volume-5362c172-5e8c-4213-9214-b17a70eaa5ef (5362c172-5e8c-4213-9214-b17a70eaa5ef): created successfully
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2d0dfb-8468-4658-9821-ba4949c1bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Flow 'volume_create_manager' (9c4c0eef-0ac5-4c87-a197-31a6e6e38126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-7feda327-b080-45e0-91e2-b1ac07015a7e" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] snapshot: 70e594c1-1ed6-4309-bdbc-fb6562475045, volume: 7feda327-b080-45e0-91e2-b1ac07015a7e,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:55:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ab0e92d0-0acc-4801-a2cb-4ab36c29a1e8 tempest-GroupSnapshotsTest-1528255746 None] Created volume successfully.
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:26 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb2c96-67c0-41dd-9961-c1fedb4aaa49]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Deleted volume successfully.
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8c4e9eba-f891-4508-ab77-2a7459a4d9d7 tempest-VolumesExtendTest-1713072628 None] Lock "cinder-65dd9e6f-5ba8-433f-abe0-594977c6ab4e-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Created reservations ['0a8c3efd-e5a4-4477-b83b-c944892b88c5', 'c92c870f-5e58-48a7-908f-c7ad34af8276', '6941d6cc-74f0-4c6f-8a35-b0e0fa23118b', 'dc0d0e57-8763-4dc7-a19c-abec655e8aa3'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:26 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:26 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:26 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:26 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] GroupSnapshot 6d4d2d1f-1dd4-423f-87b6-008283e3f8c7: creating.
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Group snapshot 6d4d2d1f-1dd4-423f-87b6-008283e3f8c7: creating. {{(pid=82421) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:26 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045" returned: 0 in 0.469s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb20a5-33fe-4539-828e-ef3e9ec030c9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:26 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Deleted volume successfully.
Apr 06 16:55:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-92e5b780-c956-4257-b51d-89ad277753b8 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-7b4ed7d7-6c1e-4769-9a88-b7eac92ae4a0-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:26 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:26 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-fa50a330-7ed3-40f0-96b4-2a505a2f451d-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-fa50a330-7ed3-40f0-96b4-2a505a2f451d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:27 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "cinder-quobyte-fa50a330-7ed3-40f0-96b4-2a505a2f451d" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.532s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-fa50a330-7ed3-40f0-96b4-2a505a2f451d" acquired by "delete_volume" :: waited 0.029s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:27 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e
Apr 06 16:55:27 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc3223a-bb4d-4f1f-92c4-bdb9486101a9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:27 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d
Apr 06 16:55:27 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:28 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d" returned: 0 in 0.960s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:28 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d
Apr 06 16:55:28 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:29 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fa50a330-7ed3-40f0-96b4-2a505a2f451d" returned: 0 in 1.083s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-quobyte-fa50a330-7ed3-40f0-96b4-2a505a2f451d" released by "delete_volume" :: held 2.071s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Created reservations ['ac1d7726-905c-4f1f-8e9a-71129af3950a', 'f22f114d-4927-48d9-8515-ebb41aaf8080', '26e9c437-ef33-4f20-839f-3de8ce46dcb8', 'c72e654f-465c-4183-9ffe-a76e5e922ef3'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:29 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:29 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:29 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e" returned: 0 in 2.356s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[163b5984-6166-4101-a801-19b27e1de270]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:29 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:29 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:29 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.514s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Deleted volume successfully.
Apr 06 16:55:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c718d4ef-0505-4fcd-aca1-865bfcfcd767 tempest-CinderUnicodeTest-257461790 None] Lock "cinder-fa50a330-7ed3-40f0-96b4-2a505a2f451d-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:30 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.774s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:55:30 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Converted 1024.00 MB image at 434.30 MB/s
Apr 06 16:55:30 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e is being set with open permissions: ugo+rw
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:30 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e
Apr 06 16:55:30 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:30 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-7feda327-b080-45e0-91e2-b1ac07015a7e" released by "_copy_volume_from_snapshot" :: held 4.659s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-70e594c1-1ed6-4309-bdbc-fb6562475045-7feda327-b080-45e0-91e2-b1ac07015a7e" released by "_create_volume_from_snapshot" :: held 4.692s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.735s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.365s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Creating offline snapshot e5efddfc-976c-4582-b289-59bd85b8d66d of volume 5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72663299-5966-4626-bc49-1c0dd71a6029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7feda327-b080-45e0-91e2-b1ac07015a7e', 'volume_size': 2, 'snapshot_id': '70e594c1-1ed6-4309-bdbc-fb6562475045'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf4e4fe-e112-46ef-a33f-42d3eb247af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4628ae76-14f8-405e-bec4-4a9827fec22c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:30 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume volume-7feda327-b080-45e0-91e2-b1ac07015a7e (7feda327-b080-45e0-91e2-b1ac07015a7e): created successfully
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf4e4fe-e112-46ef-a33f-42d3eb247af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (106c8f9a-fd79-4826-b843-ee9a37f164d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c1ef21c3-f015-4c3b-9652-716cb4676514 tempest-VolumesSnapshotTestJSON-1070078568 None] Created volume successfully.
Apr 06 16:55:30 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef
Apr 06 16:55:30 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:31 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef" returned: 0 in 0.569s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:31 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d 1G
Apr 06 16:55:31 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Flow 'volume_create_manager' (ffb62ebf-b64e-408a-abc1-964a3ba19b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce10db3-cf5a-45ce-ac74-996291500bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce10db3-cf5a-45ce-ac74-996291500bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-862132988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132c5140-c001-49f6-8cdb-fafcffca03bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9d0de03ea4cde9c02c1622e24fa09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:32Z,use_quota=True,user_id='5b65e6a3b594494484b5d263153f3ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6521b43e-94a4-4ced-9c72-8005988160b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6521b43e-94a4-4ced-9c72-8005988160b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaefc14-04a9-4f2e-8967-15153f580e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbaefc14-04a9-4f2e-8967-15153f580e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132c5140-c001-49f6-8cdb-fafcffca03bf', 'volume_name': 'volume-132c5140-c001-49f6-8cdb-fafcffca03bf', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b203fc0-ddf3-4328-aff7-10eff457f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b203fc0-ddf3-4328-aff7-10eff457f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cf1427-da50-4a44-b5df-e354d2ecd4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:31 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Volume 132c5140-c001-49f6-8cdb-fafcffca03bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132c5140-c001-49f6-8cdb-fafcffca03bf', 'volume_size': 1}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-7feda327-b080-45e0-91e2-b1ac07015a7e-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:31 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d 1G" returned: 0 in 0.630s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5362c172-5e8c-4213-9214-b17a70eaa5ef -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-7feda327-b080-45e0-91e2-b1ac07015a7e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:31 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5362c172-5e8c-4213-9214-b17a70eaa5ef -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d
Apr 06 16:55:31 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-7feda327-b080-45e0-91e2-b1ac07015a7e" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-7feda327-b080-45e0-91e2-b1ac07015a7e" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2849f4-1a80-4645-894b-d4d54e961425]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:32 devstack sudo[88562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e
Apr 06 16:55:32 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:32 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5362c172-5e8c-4213-9214-b17a70eaa5ef -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d" returned: 0 in 0.474s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:32 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:32 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d
Apr 06 16:55:32 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:32 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:32 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e
Apr 06 16:55:32 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:32 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:32 devstack sudo[88576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info
Apr 06 16:55:32 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:32 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7feda327-b080-45e0-91e2-b1ac07015a7e" returned: 0 in 0.431s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-7feda327-b080-45e0-91e2-b1ac07015a7e" released by "delete_volume" :: held 0.951s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:32 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['cf8dec4c-bbc7-48ba-a785-994783d7b67e', '3d07c138-98aa-4dec-85a8-f43ae9bd6022', '605415c9-753d-4434-bbb3-a087efcf8b45', '3560fe10-e5f8-4836-9362-8803f9493935'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:33 devstack sudo[88579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:33 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-70e594c1-1ed6-4309-bdbc-fb6562475045-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-70e594c1-1ed6-4309-bdbc-fb6562475045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-70e594c1-1ed6-4309-bdbc-fb6562475045" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-70e594c1-1ed6-4309-bdbc-fb6562475045" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Deleting offline snapshot 70e594c1-1ed6-4309-bdbc-fb6562475045 of volume d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] snapshot_file for this snap is: volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf6e467-fa75-4f7f-afd6-c9ad2976fe2c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:33 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045
Apr 06 16:55:33 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:33 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info" returned: 0 in 0.496s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:33 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:33 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info
Apr 06 16:55:33 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:33 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Deleted volume successfully.
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cec39efd-135e-416c-85eb-7e680330a7d7 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-7feda327-b080-45e0-91e2-b1ac07015a7e-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:33 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045" returned: 0 in 0.605s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea60d0-6d22-4116-b82b-1ef0993c9204]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:33 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.info" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-862132988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132c5140-c001-49f6-8cdb-fafcffca03bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9d0de03ea4cde9c02c1622e24fa09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:32Z,use_quota=True,user_id='5b65e6a3b594494484b5d263153f3ffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Creating volume 132c5140-c001-49f6-8cdb-fafcffca03bf {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:33 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:33 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:33 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:33 devstack sudo[88593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf 1073741824
Apr 06 16:55:33 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-37899ddd-29ea-4fd1-87ff-07bdfda03565 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 6d4d2d1f-1dd4-423f-87b6-008283e3f8c7: created successfully
Apr 06 16:55:34 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.552s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:34 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045
Apr 06 16:55:34 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:34 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf 1073741824" returned: 0 in 0.633s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:34 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf
Apr 06 16:55:34 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 6d4d2d1f-1dd4-423f-87b6-008283e3f8c7: deleting
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 6d4d2d1f-1dd4-423f-87b6-008283e3f8c7: deleting {{(pid=82421) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-5362c172-5e8c-4213-9214-b17a70eaa5ef" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-5362c172-5e8c-4213-9214-b17a70eaa5ef" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-e5efddfc-976c-4582-b289-59bd85b8d66d" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-e5efddfc-976c-4582-b289-59bd85b8d66d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Deleting offline snapshot e5efddfc-976c-4582-b289-59bd85b8d66d of volume 5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] snapshot_file for this snap is: volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d9f54-11ee-4ff6-8695-54823aa257de]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:34 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045" returned: 0 in 0.566s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:34 devstack sudo[88608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d
Apr 06 16:55:34 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:34 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045
Apr 06 16:55:34 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:35 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cf1427-da50-4a44-b5df-e354d2ecd4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132c5140-c001-49f6-8cdb-fafcffca03bf', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43dda691-0ca8-4b69-860d-ff5efd32ec2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:35 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Volume volume-132c5140-c001-49f6-8cdb-fafcffca03bf (132c5140-c001-49f6-8cdb-fafcffca03bf): created successfully
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43dda691-0ca8-4b69-860d-ff5efd32ec2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Flow 'volume_create_manager' (ffb62ebf-b64e-408a-abc1-964a3ba19b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:35 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-269ef15f-6379-45da-b41c-79dacf446055 tempest-VolumesNegativeTest-1144740935 None] Created volume successfully.
Apr 06 16:55:35 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d" returned: 0 in 0.606s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5362c172-5e8c-4213-9214-b17a70eaa5ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:35 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6.70e594c1-1ed6-4309-bdbc-fb6562475045" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4dd51a-31c8-45c8-945a-fa06f8c0ba95]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-70e594c1-1ed6-4309-bdbc-fb6562475045" released by "_delete_snapshot" :: held 2.297s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" released by "delete_snapshot" :: held 2.317s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['d593e84f-dacc-42a3-9b46-c647c1741d10', '09a508c7-23fe-45b6-85dd-859d1f678eef', 'd10dcb43-ca5a-4b14-b4c0-f569a7e14753', 'b1b81221-1bdc-4336-aba2-ef747fbf7ab6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:35 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef
Apr 06 16:55:35 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:35 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Delete snapshot completed successfully.
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4804755a-f7e8-46ea-a063-2882b69cdf83 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-70e594c1-1ed6-4309-bdbc-fb6562475045-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:35 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef" returned: 0 in 0.495s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:35 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d
Apr 06 16:55:35 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-d1b3f2df-23ff-4457-af78-6ff5b858bdd6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-d1b3f2df-23ff-4457-af78-6ff5b858bdd6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e96bf9-47b8-438f-a4e0-90651f8826fe]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:36 devstack sudo[88627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:36 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:36 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d" returned: 0 in 0.613s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:36 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d
Apr 06 16:55:36 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:37 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.630s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:37 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6
Apr 06 16:55:37 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:37 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef.e5efddfc-976c-4582-b289-59bd85b8d66d" returned: 0 in 0.673s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-e5efddfc-976c-4582-b289-59bd85b8d66d" released by "_delete_snapshot" :: held 2.458s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-5362c172-5e8c-4213-9214-b17a70eaa5ef" released by "delete_snapshot" :: held 2.470s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:37 devstack cinder-volume[82421]: WARNING cinder.quota [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-824521880 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-824521880, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:55:37 devstack cinder-volume[82421]: WARNING cinder.quota [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-824521880 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-824521880, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['27de1dd0-f18f-42bf-862f-21a06c4f25b9', '8b5fce6f-6894-4ff3-8a9f-7951a38162a4', 'ca4e6618-8af2-417b-9b8a-2709487e2f9f', '734c6c1f-0de1-40a4-b71a-788a4daae2eb'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:37 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0e9bda9e-3c25-46f5-814f-5c467853b431 tempest-GroupSnapshotsTest-1528255746 None] group_snapshot 6d4d2d1f-1dd4-423f-87b6-008283e3f8c7: deleted successfully
Apr 06 16:55:37 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" returned: 0 in 0.506s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-d1b3f2df-23ff-4457-af78-6ff5b858bdd6" released by "delete_volume" :: held 1.171s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['8675fabd-7972-40b3-887c-da6f51c246c2', '7e526217-fdc2-4b87-a09f-5d2464f111d4', 'ffc594b8-6e14-4405-9025-45683b55778a', '05ff380f-46f0-4adc-a6a8-96e6d624810b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:37 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:37 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:38 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.462s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Deleted volume successfully.
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-edba3c61-54b9-4913-b635-60eac218ef59 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-d1b3f2df-23ff-4457-af78-6ff5b858bdd6-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "cinder-quobyte-5362c172-5e8c-4213-9214-b17a70eaa5ef" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-5362c172-5e8c-4213-9214-b17a70eaa5ef" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0e2a57-f4b8-4528-ae2b-b92959047869]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:38 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef
Apr 06 16:55:38 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:38 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef" returned: 0 in 0.564s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:38 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef
Apr 06 16:55:38 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (27541c9b-a9a1-4e67-b1f4-cbb89cfbd11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9822ecfb-3bc9-40f1-9015-01df6e4295af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9822ecfb-3bc9-40f1-9015-01df6e4295af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-488450414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c4a9a9-6167-42ea-a32c-55b2e9896a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:39Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3431f358-4c17-47a0-96e4-6d8382d71421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3431f358-4c17-47a0-96e4-6d8382d71421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a093438-fc03-46ab-96d2-7616cd2dc87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a093438-fc03-46ab-96d2-7616cd2dc87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15c4a9a9-6167-42ea-a32c-55b2e9896a49', 'volume_name': 'volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67fc643-42b6-45f3-bdb8-9c14babd70f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67fc643-42b6-45f3-bdb8-9c14babd70f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b343336-b61f-497a-84ab-30027d1b2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:38 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume 15c4a9a9-6167-42ea-a32c-55b2e9896a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49', 'volume_size': 1}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-488450414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c4a9a9-6167-42ea-a32c-55b2e9896a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:39Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Creating volume 15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:38 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:39 devstack sudo[88652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 1073741824
Apr 06 16:55:39 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:39 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5362c172-5e8c-4213-9214-b17a70eaa5ef" returned: 0 in 0.475s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Lock "cinder-quobyte-5362c172-5e8c-4213-9214-b17a70eaa5ef" released by "delete_volume" :: held 1.070s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['f45eee3f-7760-409c-870d-9b1777eb3546'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:39 devstack cinder-volume[82421]: WARNING cinder.quota [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-824521880 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-824521880, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Created reservations ['3e1a9ada-cfe6-446e-b54c-60f9200ad801', 'b47c234a-c7b6-4b82-a063-9bfdf929a704', 'ce762507-3d6a-44c5-994c-c4ae1e6ba90f', 'b3b68462-7f7b-4ec6-9269-f7de757fe46b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:39 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 1073741824" returned: 0 in 0.595s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:39 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:39 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:39 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:39 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:40 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b343336-b61f-497a-84ab-30027d1b2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdb9539-2465-4685-a0ca-e82ac1a3b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:40 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:40 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Volume volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 (15c4a9a9-6167-42ea-a32c-55b2e9896a49): created successfully
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdb9539-2465-4685-a0ca-e82ac1a3b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (27541c9b-a9a1-4e67-b1f4-cbb89cfbd11c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.484s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:40 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-dfcc452e-2975-4772-9616-1a28765804d2 tempest-GroupSnapshotsTest-1528255746 None] Delete group completed successfully.
Apr 06 16:55:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f932f59c-49f2-4769-b011-23e0b1ed0573 tempest-VolumesSnapshotTestJSON-1070078568 None] Created volume successfully.
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Creating offline snapshot 550d49de-e755-4ebb-b032-f49109e2059f of volume 15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c1bd9-d87f-4ad5-bce6-a6e95ae60fe5]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:41 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:41 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:41 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.546s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:41 devstack sudo[88671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f 1G
Apr 06 16:55:41 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:42 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f 1G" returned: 0 in 0.539s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:42 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f
Apr 06 16:55:42 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:42 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f" returned: 0 in 0.622s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:42 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f is being set with open permissions: ugo+rw
Apr 06 16:55:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:43 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f
Apr 06 16:55:43 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:43 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:43 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info
Apr 06 16:55:43 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:44 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info" returned: 0 in 0.693s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:44 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info is being set with open permissions: ugo+rw
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:44 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info
Apr 06 16:55:44 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Flow 'volume_create_manager' (9a91dfa7-2028-407d-bc52-cfa0f05ba293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f97153b-f7b1-469d-91b9-0d5d395830d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:44 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f97153b-f7b1-469d-91b9-0d5d395830d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2066378956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c87a3f4-2390-42a9-857d-baded3db180b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e402132a85cf4eb1971aaa8b9aa9923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:45Z,use_quota=True,user_id='2bc3251177ba417287927caf9953b800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0047db-e9fd-4c53-9f39-035ade49f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0047db-e9fd-4c53-9f39-035ade49f384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c79e69-1af0-4556-905d-2a0017d3cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c79e69-1af0-4556-905d-2a0017d3cb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c87a3f4-2390-42a9-857d-baded3db180b', 'volume_name': 'volume-5c87a3f4-2390-42a9-857d-baded3db180b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6941e13-152c-45eb-871a-8ee9253cc1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6941e13-152c-45eb-871a-8ee9253cc1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d4199b-9785-4ce9-8ed7-2bd7412e7a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:44 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Volume 5c87a3f4-2390-42a9-857d-baded3db180b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c87a3f4-2390-42a9-857d-baded3db180b', 'volume_size': 1}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.info" returned: 0 in 0.507s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.471s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2066378956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c87a3f4-2390-42a9-857d-baded3db180b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e402132a85cf4eb1971aaa8b9aa9923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:45Z,use_quota=True,user_id='2bc3251177ba417287927caf9953b800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Creating volume 5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:44 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:44 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cd6c0ff7-ccd4-4451-bbc2-8ed985531dde tempest-VolumesSnapshotTestJSON-1070078568 None] Create snapshot completed successfully
Apr 06 16:55:44 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b 1073741824
Apr 06 16:55:44 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:45 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b 1073741824" returned: 0 in 0.779s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:45 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:55:45 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:45 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (9cbdfc73-15a6-468c-a687-851402bb68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25b548c-0d49-46e7-953d-66bf886bc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25b548c-0d49-46e7-953d-66bf886bc932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-287006339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80181a3-f7f8-409c-83fa-63342c739eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c98e5eb6a4ec5b78b4ea0df878ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=550d49de-e755-4ebb-b032-f49109e2059f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:46Z,use_quota=True,user_id='d43e04947b7f4c448995555162509b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eec178d-d63d-4a58-af36-64d48d107d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eec178d-d63d-4a58-af36-64d48d107d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f352d82-3d01-4e41-b9d1-320735fe6aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f352d82-3d01-4e41-b9d1-320735fe6aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f80181a3-f7f8-409c-83fa-63342c739eeb', 'volume_name': 'volume-f80181a3-f7f8-409c-83fa-63342c739eeb', 'volume_size': 1, 'snapshot_id': '550d49de-e755-4ebb-b032-f49109e2059f'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bc5777-8286-4efe-bf4d-37c52f854222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bc5777-8286-4efe-bf4d-37c52f854222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cb01b6-9db6-4940-9467-83a11a1c94b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:46 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Volume f80181a3-f7f8-409c-83fa-63342c739eeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f80181a3-f7f8-409c-83fa-63342c739eeb', 'volume_size': 1, 'snapshot_id': '550d49de-e755-4ebb-b032-f49109e2059f'}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:46 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.592s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.048s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-550d49de-e755-4ebb-b032-f49109e2059f-f80181a3-f7f8-409c-83fa-63342c739eeb" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d4199b-9785-4ce9-8ed7-2bd7412e7a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c87a3f4-2390-42a9-857d-baded3db180b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcce912-93fc-4ab6-b75b-3b2dc6a17ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:46 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Volume volume-5c87a3f4-2390-42a9-857d-baded3db180b (5c87a3f4-2390-42a9-857d-baded3db180b): created successfully
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcce912-93fc-4ab6-b75b-3b2dc6a17ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Flow 'volume_create_manager' (9a91dfa7-2028-407d-bc52-cfa0f05ba293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-550d49de-e755-4ebb-b032-f49109e2059f-f80181a3-f7f8-409c-83fa-63342c739eeb" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Creating volume f80181a3-f7f8-409c-83fa-63342c739eeb from snapshot 550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-f80181a3-f7f8-409c-83fa-63342c739eeb" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:46 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-386cf05c-2652-4511-b484-53bddb1e45b4 tempest-SnapshotDependencyTests-395109013 None] Created volume successfully.
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-f80181a3-f7f8-409c-83fa-63342c739eeb" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] snapshot: 550d49de-e755-4ebb-b032-f49109e2059f, volume: f80181a3-f7f8-409c-83fa-63342c739eeb,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967bfce-2b40-4654-98a1-64cee423380e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:46 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f
Apr 06 16:55:46 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:46 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-bd09b149-d905-4dbc-91a8-5de19303b5da tempest-GroupSnapshotsV319Test-1696997982 None] Group tempest-GroupSnapshotsV319Test-Group-2086651901: creating
Apr 06 16:55:46 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-bd09b149-d905-4dbc-91a8-5de19303b5da tempest-GroupSnapshotsV319Test-1696997982 None] Group tempest-GroupSnapshotsV319Test-Group-2086651901: created successfully
Apr 06 16:55:46 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-bd09b149-d905-4dbc-91a8-5de19303b5da tempest-GroupSnapshotsV319Test-1696997982 None] Create group completed successfully.
Apr 06 16:55:46 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f" returned: 0 in 0.564s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd3a52a-2ca7-42b5-a000-77fa708307f5]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:46 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:46 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:47 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.500s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:47 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:55:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:47 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb
Apr 06 16:55:47 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Flow 'volume_create_manager' (48099790-4eb4-4535-ac6f-0157f27219c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0cae83-2ab2-4554-adab-fa50fde6ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0cae83-2ab2-4554-adab-fa50fde6ee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1843086821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4938e307-0abc-4376-8fec-8aa22760d0e1,host='devstack@QuobyteHD#QuobyteHD',id=4d1e8e26-0e4e-4a71-9536-9634efa22d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e750da1f284998ab9c05022aefc0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:48Z,use_quota=True,user_id='b5a341d6eb7a41bbb2f9e15d2ff3d960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4298bd57-1530-4c3a-beb2-041b1f190801),volume_type_id=4298bd57-1530-4c3a-beb2-041b1f190801)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17741cc-6e08-48c4-a8cc-6bb6d3e31988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17741cc-6e08-48c4-a8cc-6bb6d3e31988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e87544-d4e1-4483-ad97-93c07dc4cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e87544-d4e1-4483-ad97-93c07dc4cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1e8e26-0e4e-4a71-9536-9634efa22d49', 'volume_name': 'volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9c94ee-8f5e-4509-ba1e-bef982894b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9c94ee-8f5e-4509-ba1e-bef982894b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3380e-b859-4d13-aeb4-9b1abea75aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:48 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Volume 4d1e8e26-0e4e-4a71-9536-9634efa22d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49', 'volume_size': 1}
Apr 06 16:55:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:49 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb" returned: 0 in 2.356s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a830455-0571-4bed-a708-2193e6421f33]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:49 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:49 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:50 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.596s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:55:50 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Converted 1024.00 MB image at 434.43 MB/s
Apr 06 16:55:50 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb is being set with open permissions: ugo+rw
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:50 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb
Apr 06 16:55:50 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:50 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb" returned: 0 in 0.423s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-f80181a3-f7f8-409c-83fa-63342c739eeb" released by "_copy_volume_from_snapshot" :: held 4.516s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-550d49de-e755-4ebb-b032-f49109e2059f-f80181a3-f7f8-409c-83fa-63342c739eeb" released by "_create_volume_from_snapshot" :: held 4.547s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.592s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.843s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Creating offline snapshot f0a78b9a-3080-4873-8cd9-7682dd64c62f of volume 5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cb01b6-9db6-4940-9467-83a11a1c94b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80181a3-f7f8-409c-83fa-63342c739eeb', 'volume_size': 1, 'snapshot_id': '550d49de-e755-4ebb-b032-f49109e2059f'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14094ae7-e56f-41cf-b914-08130d3b55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7d6fa-bf7a-4b45-98d4-8872e81c9d95]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:50 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Volume volume-f80181a3-f7f8-409c-83fa-63342c739eeb (f80181a3-f7f8-409c-83fa-63342c739eeb): created successfully
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14094ae7-e56f-41cf-b914-08130d3b55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Flow 'volume_create_manager' (9cbdfc73-15a6-468c-a687-851402bb68c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1bbe3feb-ce16-46f8-8587-2b9f88395b8c tempest-VolumesSnapshotTestJSON-1070078568 None] Created volume successfully.
Apr 06 16:55:50 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:55:50 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:51 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.505s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:51 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f 1G
Apr 06 16:55:51 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-f80181a3-f7f8-409c-83fa-63342c739eeb-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-f80181a3-f7f8-409c-83fa-63342c739eeb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-f80181a3-f7f8-409c-83fa-63342c739eeb" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-f80181a3-f7f8-409c-83fa-63342c739eeb" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a3158-c62f-4fc5-91ec-49fe49240651]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:51 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb
Apr 06 16:55:51 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:51 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f 1G" returned: 0 in 0.672s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c87a3f4-2390-42a9-857d-baded3db180b -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:51 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c87a3f4-2390-42a9-857d-baded3db180b -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f
Apr 06 16:55:51 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:52 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb" returned: 0 in 0.612s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:52 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb
Apr 06 16:55:52 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:52 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c87a3f4-2390-42a9-857d-baded3db180b -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f" returned: 0 in 0.526s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:52 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f is being set with open permissions: ugo+rw
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:52 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f
Apr 06 16:55:52 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:52 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f80181a3-f7f8-409c-83fa-63342c739eeb" returned: 0 in 0.491s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-f80181a3-f7f8-409c-83fa-63342c739eeb" released by "delete_volume" :: held 1.131s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['ebcd3ee9-7e00-4ff1-a255-19903d234d3c', 'a77a6de1-3146-4652-bc6b-f9f696d3ca6b', '6c9d05b2-d9a8-477b-a4cb-3fbbac78dbc0', '607fea3b-410e-4dc1-a7f6-40a2f7f673e3'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:52 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:52 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:52 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:52 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info
Apr 06 16:55:52 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:53 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Deleted volume successfully.
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ad804800-4a7c-41ca-9149-5196039e7414 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-f80181a3-f7f8-409c-83fa-63342c739eeb-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:53 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info" returned: 0 in 0.443s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:53 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info is being set with open permissions: ugo+rw
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:53 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info
Apr 06 16:55:53 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-550d49de-e755-4ebb-b032-f49109e2059f-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-550d49de-e755-4ebb-b032-f49109e2059f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-15c4a9a9-6167-42ea-a32c-55b2e9896a49" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-15c4a9a9-6167-42ea-a32c-55b2e9896a49" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-550d49de-e755-4ebb-b032-f49109e2059f" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-550d49de-e755-4ebb-b032-f49109e2059f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Deleting offline snapshot 550d49de-e755-4ebb-b032-f49109e2059f of volume 15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] snapshot_file for this snap is: volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6179169-ddae-47d6-b9d0-b8bfb6e62e46]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:53 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f
Apr 06 16:55:53 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:53 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.info" returned: 0 in 0.521s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.202s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.487s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4938e307-0abc-4376-8fec-8aa22760d0e1,created_at=2026-04-06T14:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1843086821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4938e307-0abc-4376-8fec-8aa22760d0e1,host='devstack@QuobyteHD#QuobyteHD',id=4d1e8e26-0e4e-4a71-9536-9634efa22d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e750da1f284998ab9c05022aefc0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:48Z,use_quota=True,user_id='b5a341d6eb7a41bbb2f9e15d2ff3d960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4298bd57-1530-4c3a-beb2-041b1f190801),volume_type_id=4298bd57-1530-4c3a-beb2-041b1f190801)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Creating volume 4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:53 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:55:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:53 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 1073741824
Apr 06 16:55:53 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-7cd2175d-4eb1-4c1f-8b3d-883cadda8f0c tempest-SnapshotDependencyTests-395109013 None] Create snapshot completed successfully
Apr 06 16:55:54 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f" returned: 0 in 0.509s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5c3ea-bcf2-425f-be67-0fdf9490ecc3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:54 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:54 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:54 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 1073741824" returned: 0 in 0.522s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:54 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49
Apr 06 16:55:54 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Flow 'volume_create_manager' (cd9ee7c2-88c2-4df6-8926-4cccd15db537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc9ce4-d473-4c95-ac1f-0db90d5611e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fc9ce4-d473-4c95-ac1f-0db90d5611e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c872c6f5-116f-431b-8529-991f5a4a538f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e402132a85cf4eb1971aaa8b9aa9923c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0a78b9a-3080-4873-8cd9-7682dd64c62f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:55:55Z,use_quota=True,user_id='2bc3251177ba417287927caf9953b800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89600877-5d11-465b-8792-a1a9d985fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89600877-5d11-465b-8792-a1a9d985fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d859c1-4549-4a74-96d1-702d216ba2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d859c1-4549-4a74-96d1-702d216ba2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c872c6f5-116f-431b-8529-991f5a4a538f', 'volume_name': 'volume-c872c6f5-116f-431b-8529-991f5a4a538f', 'volume_size': 1, 'snapshot_id': 'f0a78b9a-3080-4873-8cd9-7682dd64c62f'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaee1bc-7c59-4047-9666-c359e8ff3c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaee1bc-7c59-4047-9666-c359e8ff3c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0138cc-1510-4194-ac62-e9d2975df512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:54 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Volume c872c6f5-116f-431b-8529-991f5a4a538f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c872c6f5-116f-431b-8529-991f5a4a538f', 'volume_size': 1, 'snapshot_id': 'f0a78b9a-3080-4873-8cd9-7682dd64c62f'}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:54 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.512s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:54 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f
Apr 06 16:55:54 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:55 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49" returned: 0 in 0.573s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.392s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-quobyte-f0a78b9a-3080-4873-8cd9-7682dd64c62f-c872c6f5-116f-431b-8529-991f5a4a538f" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3380e-b859-4d13-aeb4-9b1abea75aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0bb386-e182-471a-a617-d60a755f4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:55 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Volume volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 (4d1e8e26-0e4e-4a71-9536-9634efa22d49): created successfully
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0bb386-e182-471a-a617-d60a755f4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Flow 'volume_create_manager' (48099790-4eb4-4535-ac6f-0157f27219c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-f0a78b9a-3080-4873-8cd9-7682dd64c62f-c872c6f5-116f-431b-8529-991f5a4a538f" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Creating volume c872c6f5-116f-431b-8529-991f5a4a538f from snapshot f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-quobyte-c872c6f5-116f-431b-8529-991f5a4a538f" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:55 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-77497e4e-0522-49e3-a5eb-7d2449c9507c tempest-GroupSnapshotsV319Test-1696997982 None] Created volume successfully.
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-c872c6f5-116f-431b-8529-991f5a4a538f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] snapshot: f0a78b9a-3080-4873-8cd9-7682dd64c62f, volume: c872c6f5-116f-431b-8529-991f5a4a538f,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[19522f59-c490-4b6e-ae8d-3095d36053a3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:55 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f
Apr 06 16:55:55 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:55 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:55 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f
Apr 06 16:55:55 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:55 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49.550d49de-e755-4ebb-b032-f49109e2059f" returned: 0 in 0.413s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:55 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-550d49de-e755-4ebb-b032-f49109e2059f" released by "_delete_snapshot" :: held 2.036s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f" returned: 0 in 0.602s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c87a3f4-2390-42a9-857d-baded3db180b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-15c4a9a9-6167-42ea-a32c-55b2e9896a49" released by "delete_snapshot" :: held 2.067s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b46205-663b-47a5-95d8-0da3f112d654]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['362d3ad6-1375-4c0a-88fb-05f45dd23e57', '3b2041ac-9787-4b03-88f4-b44b31e6da6c', 'fb5ff8a0-2887-4f00-97fc-0974caebe805', 'ed916e10-9961-4e50-81d9-a04253c8d7b4'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:55 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Delete snapshot completed successfully.
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6795e60d-2916-443c-bd09-36ccaf0312f8 tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-550d49de-e755-4ebb-b032-f49109e2059f-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:55 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:55:55 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:55 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] GroupSnapshot c97a5ef1-e668-4f1b-99e2-b775b00e5037: creating.
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Group snapshot c97a5ef1-e668-4f1b-99e2-b775b00e5037: creating. {{(pid=82421) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}}
Apr 06 16:55:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:56 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.508s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:56 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:55:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:56 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f
Apr 06 16:55:56 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-15c4a9a9-6167-42ea-a32c-55b2e9896a49-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-15c4a9a9-6167-42ea-a32c-55b2e9896a49-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-15c4a9a9-6167-42ea-a32c-55b2e9896a49" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-15c4a9a9-6167-42ea-a32c-55b2e9896a49" acquired by "delete_volume" :: waited 0.024s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:57 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d640e7-c8b9-4c27-8cbd-2f3806d4acd3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:57 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:57 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:58 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.961s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:58 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49
Apr 06 16:55:58 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:58 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f" returned: 0 in 2.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d0b6f-b20c-4e4f-9e6e-92129741678d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:58 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:55:58 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:59 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-15c4a9a9-6167-42ea-a32c-55b2e9896a49" returned: 0 in 0.638s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-15c4a9a9-6167-42ea-a32c-55b2e9896a49" released by "delete_volume" :: held 1.654s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['487df714-774c-4aba-9099-323325c62b32', '65b55382-f3bc-43dc-87d0-8852ee861461', '41575c3a-fb85-45b0-ba60-e984928feaff', '6031baf8-b1ed-4560-9469-fa02b30827b2'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:59 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:55:59 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:59 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.610s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:55:59 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Converted 1024.00 MB image at 408.85 MB/s
Apr 06 16:55:59 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f is being set with open permissions: ugo+rw
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:59 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f
Apr 06 16:55:59 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:59 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:55:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Deleted volume successfully.
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f97f9368-9039-477b-ad12-bab844b50ede tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-15c4a9a9-6167-42ea-a32c-55b2e9896a49-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-538b67e9-7d2f-430e-a692-0ecfa664ae74-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-538b67e9-7d2f-430e-a692-0ecfa664ae74-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "cinder-quobyte-538b67e9-7d2f-430e-a692-0ecfa664ae74" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-538b67e9-7d2f-430e-a692-0ecfa664ae74" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[05423b4e-703a-415b-8eb9-885730c8f1f2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:59 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-c872c6f5-116f-431b-8529-991f5a4a538f" released by "_copy_volume_from_snapshot" :: held 4.725s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-f0a78b9a-3080-4873-8cd9-7682dd64c62f-c872c6f5-116f-431b-8529-991f5a4a538f" released by "_create_volume_from_snapshot" :: held 4.752s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.798s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:55:59 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74
Apr 06 16:55:59 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.928s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Creating offline snapshot 9f4166cb-b26c-4926-a0b5-6911cc2598a3 of volume 4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0138cc-1510-4194-ac62-e9d2975df512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c872c6f5-116f-431b-8529-991f5a4a538f', 'volume_size': 1, 'snapshot_id': 'f0a78b9a-3080-4873-8cd9-7682dd64c62f'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27794752-8043-43ee-b8d1-d99fa5fd20c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07ac6a2-98ec-4121-a199-09f9cc2b462f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:55:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Volume volume-c872c6f5-116f-431b-8529-991f5a4a538f (c872c6f5-116f-431b-8529-991f5a4a538f): created successfully
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27794752-8043-43ee-b8d1-d99fa5fd20c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:55:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Flow 'volume_create_manager' (cd9ee7c2-88c2-4df6-8926-4cccd15db537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:55:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2c7e5b4c-6fa4-40ae-b96e-82c6ca784ca3 tempest-SnapshotDependencyTests-395109013 None] Created volume successfully.
Apr 06 16:56:00 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49
Apr 06 16:56:00 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-f0a78b9a-3080-4873-8cd9-7682dd64c62f-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-f0a78b9a-3080-4873-8cd9-7682dd64c62f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-quobyte-5c87a3f4-2390-42a9-857d-baded3db180b" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-5c87a3f4-2390-42a9-857d-baded3db180b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-quobyte-f0a78b9a-3080-4873-8cd9-7682dd64c62f" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-f0a78b9a-3080-4873-8cd9-7682dd64c62f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Deleting offline snapshot f0a78b9a-3080-4873-8cd9-7682dd64c62f of volume 5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] snapshot_file for this snap is: volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[965582c0-e72d-4955-871d-cee2c07f8594]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:00 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f
Apr 06 16:56:00 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:00 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74" returned: 0 in 0.547s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:00 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74
Apr 06 16:56:00 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:00 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49" returned: 0 in 0.529s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:00 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 1G
Apr 06 16:56:00 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:00 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f" returned: 0 in 0.472s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c87a3f4-2390-42a9-857d-baded3db180b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56dce2-6d03-44ff-8504-6515ccb13d35]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:00 devstack sudo[88934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:56:00 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:00 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-538b67e9-7d2f-430e-a692-0ecfa664ae74" returned: 0 in 0.404s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-quobyte-538b67e9-7d2f-430e-a692-0ecfa664ae74" released by "delete_volume" :: held 0.987s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Created reservations ['dd4e03e2-ca02-490d-a108-ce430dedf54a', 'a35fe8df-af18-48f0-9c14-eb1487cfeb62', '639075f1-be36-4380-ae1c-0312a529fd56', '88e0f775-db16-484a-857a-fb3812c5fb93'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:00 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:00 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:00 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 1G" returned: 0 in 0.515s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:00 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3
Apr 06 16:56:00 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:01 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.502s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:01 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f
Apr 06 16:56:01 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:01 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Deleted volume successfully.
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-49474121-5645-4339-8fcc-84a4036345dd tempest-VolumesSnapshotTestJSON-1070078568 None] Lock "cinder-538b67e9-7d2f-430e-a692-0ecfa664ae74-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:01 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:01 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:01 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3
Apr 06 16:56:01 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:01 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f" returned: 0 in 0.486s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:01 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f
Apr 06 16:56:01 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:01 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3" returned: 0 in 0.418s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:01 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info
Apr 06 16:56:01 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:02 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b.f0a78b9a-3080-4873-8cd9-7682dd64c62f" returned: 0 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-f0a78b9a-3080-4873-8cd9-7682dd64c62f" released by "_delete_snapshot" :: held 1.961s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-5c87a3f4-2390-42a9-857d-baded3db180b" released by "delete_snapshot" :: held 1.972s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Created reservations ['ba1a4659-a72c-4aa7-be21-7116f66505ba', '1ad22fa6-60a9-4f8e-a18c-a465333c2ac3', '4fcf513c-9118-485f-bd59-0d7172937733', '7a87b07b-58ea-45a2-9ae8-b3aca131c368'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Delete snapshot completed successfully.
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9591ea55-0307-46aa-a733-6526279425a5 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-f0a78b9a-3080-4873-8cd9-7682dd64c62f-delete_snapshot" released by "delete_snapshot" :: held 2.064s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-5c87a3f4-2390-42a9-857d-baded3db180b-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-5c87a3f4-2390-42a9-857d-baded3db180b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-quobyte-5c87a3f4-2390-42a9-857d-baded3db180b" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-5c87a3f4-2390-42a9-857d-baded3db180b" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[af60a75f-e12c-4f62-9a8d-8da1a97d5609]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:02 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:56:02 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:02 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info" returned: 0 in 0.473s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:02 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:02 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info
Apr 06 16:56:02 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:02 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:02 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.info" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.882s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.524s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:02 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b
Apr 06 16:56:02 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-be6d7597-ff54-45f7-ab2b-1cd40557db2e tempest-GroupSnapshotsV319Test-1696997982 None] group_snapshot c97a5ef1-e668-4f1b-99e2-b775b00e5037: created successfully
Apr 06 16:56:03 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5c87a3f4-2390-42a9-857d-baded3db180b" returned: 0 in 0.487s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-5c87a3f4-2390-42a9-857d-baded3db180b" released by "delete_volume" :: held 1.042s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Created reservations ['f96cf8af-340c-4405-a980-37a016a3740d', '62e46f1c-243b-46f9-9a62-40926dd4775c', 'd2a98d29-595d-4a45-b3a2-49601afec9bf', 'da2c3cd3-6ab8-49be-824e-b5ff03e020ea'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:03 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:03 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] group_snapshot c97a5ef1-e668-4f1b-99e2-b775b00e5037: deleting
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] group_snapshot c97a5ef1-e668-4f1b-99e2-b775b00e5037: deleting {{(pid=82421) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "cinder-quobyte-4d1e8e26-0e4e-4a71-9536-9634efa22d49" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:03 devstack sudo[88980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:03 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Lock "cinder-quobyte-4d1e8e26-0e4e-4a71-9536-9634efa22d49" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "cinder-quobyte-9f4166cb-b26c-4926-a0b5-6911cc2598a3" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Lock "cinder-quobyte-9f4166cb-b26c-4926-a0b5-6911cc2598a3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Deleting offline snapshot 9f4166cb-b26c-4926-a0b5-6911cc2598a3 of volume 4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] snapshot_file for this snap is: volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af00f88-88c9-44d3-a86c-7ac01b3b5f73]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:03 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3
Apr 06 16:56:03 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:03 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.576s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:03 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Deleted volume successfully.
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-12c25ea6-8540-4816-9b82-f37b0c964209 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-5c87a3f4-2390-42a9-857d-baded3db180b-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:04 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.544s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-c872c6f5-116f-431b-8529-991f5a4a538f-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:04 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3" returned: 0 in 0.633s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[229fc212-41a8-4ab1-9a73-68c89b3798b9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-c872c6f5-116f-431b-8529-991f5a4a538f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "cinder-quobyte-c872c6f5-116f-431b-8529-991f5a4a538f" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-c872c6f5-116f-431b-8529-991f5a4a538f" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[885b69e7-2569-43a6-9dd6-f1b9ef208d1d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:04 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49
Apr 06 16:56:04 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:04 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f
Apr 06 16:56:04 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:05 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49" returned: 0 in 0.615s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:05 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3
Apr 06 16:56:05 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:05 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f" returned: 0 in 0.679s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:05 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f
Apr 06 16:56:05 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:05 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3" returned: 0 in 0.552s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:05 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3
Apr 06 16:56:05 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:05 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c872c6f5-116f-431b-8529-991f5a4a538f" returned: 0 in 0.542s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-quobyte-c872c6f5-116f-431b-8529-991f5a4a538f" released by "delete_volume" :: held 1.244s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Created reservations ['1132bf0e-904e-4ee4-b5f6-a3ea2e29dd07', '923c3e5e-742d-4643-8ec2-f58a71c2bfb3', 'd291648c-3d1f-4c8a-8495-b71629f64d82', '942be2fa-f5d4-451c-9672-3dd98048c747'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:05 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:05 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:06 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49.9f4166cb-b26c-4926-a0b5-6911cc2598a3" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Lock "cinder-quobyte-9f4166cb-b26c-4926-a0b5-6911cc2598a3" released by "_delete_snapshot" :: held 2.315s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Lock "cinder-quobyte-4d1e8e26-0e4e-4a71-9536-9634efa22d49" released by "delete_snapshot" :: held 2.351s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:06 devstack cinder-volume[82421]: WARNING cinder.quota [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1768772711 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1768772711, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:06 devstack cinder-volume[82421]: WARNING cinder.quota [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1768772711 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1768772711, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] Created reservations ['b42b98cd-8416-407b-b095-cd824c74c74d', 'b6e670d7-f9fe-40a5-8377-0a0acf75cae9', '3f18cc10-7d2c-4ae5-89d0-1efac748fcb3', '8eff5b6a-0208-4e19-aed8-d0e0676b5088'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-15263132-ddc4-404b-8000-d5aa7f03987d tempest-GroupSnapshotsV319Test-1696997982 None] group_snapshot c97a5ef1-e668-4f1b-99e2-b775b00e5037: deleted successfully
Apr 06 16:56:06 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.440s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Deleted volume successfully.
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-bbdf8b1b-5249-41b7-85a8-f5957f6a3fe9 tempest-SnapshotDependencyTests-395109013 None] Lock "cinder-c872c6f5-116f-431b-8529-991f5a4a538f-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Flow 'volume_create_manager' (1e2c8441-11e8-4974-bcb5-3a907b793929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2036ffa-02f6-4929-a14f-0274ad567089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2036ffa-02f6-4929-a14f-0274ad567089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1040326920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe5e679-bc0b-4e57-b647-cdbd3f3bd835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614e9f128f8b48d5adcc7c08e08ed334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:06Z,use_quota=True,user_id='3ea6d30b4bd24619a229b9f0b5e3bf09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb252480-2756-4e6d-8e6a-fdbdcc997864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb252480-2756-4e6d-8e6a-fdbdcc997864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d121f3c8-506a-4c4f-a1e2-a72e810efcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d121f3c8-506a-4c4f-a1e2-a72e810efcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe5e679-bc0b-4e57-b647-cdbd3f3bd835', 'volume_name': 'volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42b2b8d-45ee-4fc5-90cf-ac411e54da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42b2b8d-45ee-4fc5-90cf-ac411e54da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2054aa20-bd90-49ab-a9ed-6959196278b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:06 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835', 'volume_size': 1}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1040326920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe5e679-bc0b-4e57-b647-cdbd3f3bd835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614e9f128f8b48d5adcc7c08e08ed334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:06Z,use_quota=True,user_id='3ea6d30b4bd24619a229b9f0b5e3bf09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Creating volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:06 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:06 devstack sudo[89015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 1073741824
Apr 06 16:56:06 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:07 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 1073741824" returned: 0 in 0.648s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "cinder-quobyte-4d1e8e26-0e4e-4a71-9536-9634efa22d49" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Lock "cinder-quobyte-4d1e8e26-0e4e-4a71-9536-9634efa22d49" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[037b03d6-b768-4396-a5a1-6d18efca6582]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:07 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835
Apr 06 16:56:07 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:07 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49
Apr 06 16:56:07 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Acquiring lock "cinder-132c5140-c001-49f6-8cdb-fafcffca03bf-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Lock "cinder-132c5140-c001-49f6-8cdb-fafcffca03bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Acquiring lock "cinder-quobyte-132c5140-c001-49f6-8cdb-fafcffca03bf" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Lock "cinder-quobyte-132c5140-c001-49f6-8cdb-fafcffca03bf" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d03725-2711-4f76-9127-3d09d8cefb29]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:07 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf
Apr 06 16:56:07 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:07 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" returned: 0 in 0.520s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2054aa20-bd90-49ab-a9ed-6959196278b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bb8064-b5ef-4d4f-a153-91d4f24e10da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:07 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49" returned: 0 in 0.559s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:07 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Volume volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 (cfe5e679-bc0b-4e57-b647-cdbd3f3bd835): created successfully
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bb8064-b5ef-4d4f-a153-91d4f24e10da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Flow 'volume_create_manager' (1e2c8441-11e8-4974-bcb5-3a907b793929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:07 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49
Apr 06 16:56:07 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:07 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6c2d5b3d-7367-4c68-be76-36b3011511c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Created volume successfully.
Apr 06 16:56:08 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf" returned: 0 in 0.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:08 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf
Apr 06 16:56:08 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:08 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4d1e8e26-0e4e-4a71-9536-9634efa22d49" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Lock "cinder-quobyte-4d1e8e26-0e4e-4a71-9536-9634efa22d49" released by "delete_volume" :: held 1.016s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Created reservations ['43fa7c47-3d3d-40d5-9f4e-3a9ce2b5cf1c'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:08 devstack cinder-volume[82421]: WARNING cinder.quota [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1768772711 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1768772711, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Created reservations ['beacdb45-a5d8-4bf3-b219-cf029051adbf', '14d0ca9a-8b04-47e9-b315-8985acce5773', 'f50ed29c-28a3-41cd-9215-6552815ac1f7', '935683df-7ba7-42d5-925c-1143c2fc1af7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:08 devstack sudo[89039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:08 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:08 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-132c5140-c001-49f6-8cdb-fafcffca03bf" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Lock "cinder-quobyte-132c5140-c001-49f6-8cdb-fafcffca03bf" released by "delete_volume" :: held 0.923s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Created reservations ['4f6150e3-da0a-4061-a2d5-33e3d2fe92e1', 'b21775ad-8bed-48ef-8687-eb418fbfbb8f', '524a764d-58c5-400e-a1f2-7482b3c01606', '7e82fb4d-715b-4911-84a2-dba03d147f61'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:08 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:08 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Creating offline snapshot a589d378-a9a5-4356-ac63-f4ce4665e9d2 of volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3e9fc-83b6-4863-9046-62c9afc81216]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:08 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.517s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:08 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-48c799ec-7183-492f-9b04-57febe6ee165 tempest-GroupSnapshotsV319Test-1696997982 None] Delete group completed successfully.
Apr 06 16:56:08 devstack sudo[89045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835
Apr 06 16:56:08 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:09 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.754s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:09 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Deleted volume successfully.
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a740a90-c644-4ea7-b910-a420a3e12f7b tempest-VolumesNegativeTest-1144740935 None] Lock "cinder-132c5140-c001-49f6-8cdb-fafcffca03bf-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:09 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" returned: 0 in 0.660s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:09 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 1G
Apr 06 16:56:09 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:09 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 1G" returned: 0 in 0.612s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:10 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:10 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:10 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.600s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:10 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 is being set with open permissions: ugo+rw
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:10 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:10 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (ef3b8407-7246-43c0-89f0-f4d95dc43579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2740686f-7187-43ca-9751-73c125c7b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2740686f-7187-43ca-9751-73c125c7b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-561834653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3000f3-03db-490f-8d38-88bb6574def7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:11Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03f464b-f7cf-44bc-a62c-312bfaf36a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03f464b-f7cf-44bc-a62c-312bfaf36a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b641668e-159e-473d-a80a-fa149cb52582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b641668e-159e-473d-a80a-fa149cb52582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3000f3-03db-490f-8d38-88bb6574def7', 'volume_name': 'volume-0f3000f3-03db-490f-8d38-88bb6574def7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef5b175-1ed0-49e4-9a0d-b09b117c26a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef5b175-1ed0-49e4-9a0d-b09b117c26a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96de6e1b-ff43-462e-8352-71232fcc52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume 0f3000f3-03db-490f-8d38-88bb6574def7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3000f3-03db-490f-8d38-88bb6574def7', 'volume_size': 1}
Apr 06 16:56:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:11 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.465s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:11 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info
Apr 06 16:56:11 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:11 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:11 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info is being set with open permissions: ugo+rw
Apr 06 16:56:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:11 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info
Apr 06 16:56:11 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:11 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.info" returned: 0 in 0.477s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.319s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-561834653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3000f3-03db-490f-8d38-88bb6574def7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:11Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating volume 0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:12 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2ec06abc-9ed8-4485-b3ef-9ea5c67f04c2 tempest-VolumesSnapshotListTestJSON-1164068656 None] Create snapshot completed successfully
Apr 06 16:56:12 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 1073741824
Apr 06 16:56:12 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:12 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 1073741824" returned: 0 in 0.589s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:12 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7
Apr 06 16:56:12 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-95f3d9a8-6dfb-4f4d-9fa6-b67758f33193 tempest-GroupsTest-1151299146 None] Group tempest-Group1-841641226: creating
Apr 06 16:56:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-95f3d9a8-6dfb-4f4d-9fa6-b67758f33193 tempest-GroupsTest-1151299146 None] Group tempest-Group1-841641226: created successfully
Apr 06 16:56:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-95f3d9a8-6dfb-4f4d-9fa6-b67758f33193 tempest-GroupsTest-1151299146 None] Create group completed successfully.
Apr 06 16:56:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:13 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7" returned: 0 in 0.544s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.270s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Creating offline snapshot b30100e3-70bc-46f0-8a37-2ad1d4a9c441 of volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96de6e1b-ff43-462e-8352-71232fcc52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3000f3-03db-490f-8d38-88bb6574def7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ae3d51-8212-45b3-92dd-b3701114066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55168274-2c68-4673-8be2-bf1ec9f4f1a4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume volume-0f3000f3-03db-490f-8d38-88bb6574def7 (0f3000f3-03db-490f-8d38-88bb6574def7): created successfully
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ae3d51-8212-45b3-92dd-b3701114066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (ef3b8407-7246-43c0-89f0-f4d95dc43579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3d62c776-42ca-4a57-954b-ccc4b11fc532 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created volume successfully.
Apr 06 16:56:13 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:13 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:13 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:13 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 1G
Apr 06 16:56:13 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0f317dc0-9111-4e5a-819f-42dfc1e160a0 tempest-GroupsTest-1151299146 None] Group tempest-Group2-387752143: creating
Apr 06 16:56:13 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0f317dc0-9111-4e5a-819f-42dfc1e160a0 tempest-GroupsTest-1151299146 None] Group tempest-Group2-387752143: created successfully
Apr 06 16:56:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0f317dc0-9111-4e5a-819f-42dfc1e160a0 tempest-GroupsTest-1151299146 None] Create group completed successfully.
Apr 06 16:56:14 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 1G" returned: 0 in 0.569s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:14 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:14 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:14 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.405s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:14 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 is being set with open permissions: ugo+rw
Apr 06 16:56:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:14 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:14 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:15 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.407s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.224s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating offline snapshot 66d89d67-8882-4708-b6c9-46d6d0605323 of volume 0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[556f5541-48e8-4f13-90df-5f4c31be8a63]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-40449ae3-89f5-4cf1-9365-00ee07654440 tempest-VolumesSnapshotListTestJSON-1164068656 None] Create snapshot completed successfully
Apr 06 16:56:15 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7
Apr 06 16:56:15 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Flow 'volume_create_manager' (cc20183d-1a96-47f0-8eaf-1fb2b39e700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd801296-dbed-44d3-aa1d-1e8f864807cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd801296-dbed-44d3-aa1d-1e8f864807cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035204658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7495e6c6-6632-4beb-adb0-5873faf7f3a4,host='devstack@QuobyteHD#QuobyteHD',id=42a66598-4e2c-4053-b825-b3a19ed4872e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2006c48318694941ab4e192253151822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:15Z,use_quota=True,user_id='6564e5a8aad049a9b521681cda83623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c05a2b33-4714-4061-b401-773308987cf4),volume_type_id=c05a2b33-4714-4061-b401-773308987cf4)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e507b62-86af-4d00-8da2-cc00cc5833af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e507b62-86af-4d00-8da2-cc00cc5833af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7f602b-249f-479b-809e-33b9c5b2ebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7f602b-249f-479b-809e-33b9c5b2ebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a66598-4e2c-4053-b825-b3a19ed4872e', 'volume_name': 'volume-42a66598-4e2c-4053-b825-b3a19ed4872e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab32d25-a329-4f66-a746-d42aa72d1908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab32d25-a329-4f66-a746-d42aa72d1908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b44a77c-5a16-4c36-a313-db1ac076ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:15 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Volume 42a66598-4e2c-4053-b825-b3a19ed4872e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a66598-4e2c-4053-b825-b3a19ed4872e', 'volume_size': 1}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:15 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7" returned: 0 in 0.479s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:15 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 1G
Apr 06 16:56:15 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:16 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 1G" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3000f3-03db-490f-8d38-88bb6574def7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:16 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3000f3-03db-490f-8d38-88bb6574def7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323
Apr 06 16:56:16 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:16 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3000f3-03db-490f-8d38-88bb6574def7 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323" returned: 0 in 0.423s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:16 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 is being set with open permissions: ugo+rw
Apr 06 16:56:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:16 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323
Apr 06 16:56:16 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:16 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:17 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info
Apr 06 16:56:17 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:17 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info" returned: 0 in 0.388s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:17 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info is being set with open permissions: ugo+rw
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:17 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info
Apr 06 16:56:17 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:17 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.info" returned: 0 in 0.381s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7495e6c6-6632-4beb-adb0-5873faf7f3a4,created_at=2026-04-06T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035204658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7495e6c6-6632-4beb-adb0-5873faf7f3a4,host='devstack@QuobyteHD#QuobyteHD',id=42a66598-4e2c-4053-b825-b3a19ed4872e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2006c48318694941ab4e192253151822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:15Z,use_quota=True,user_id='6564e5a8aad049a9b521681cda83623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c05a2b33-4714-4061-b401-773308987cf4),volume_type_id=c05a2b33-4714-4061-b401-773308987cf4)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Creating volume 42a66598-4e2c-4053-b825-b3a19ed4872e {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:17 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f86a035a-ae63-4f69-a626-b658779d39b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Create snapshot completed successfully
Apr 06 16:56:17 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e 1073741824
Apr 06 16:56:17 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (19adf4e1-8e64-4727-a93e-f08c51359915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a9ea06-e9ff-4ea0-9cb7-ee9dba6542bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a9ea06-e9ff-4ea0-9cb7-ee9dba6542bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157193880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14c6450-6baa-4a58-b546-e0f297f92cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:18Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe015e-ec73-4bbe-89dc-734388c8deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe015e-ec73-4bbe-89dc-734388c8deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce63bf44-af29-40b8-b5cb-cc10cb293616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce63bf44-af29-40b8-b5cb-cc10cb293616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14c6450-6baa-4a58-b546-e0f297f92cfe', 'volume_name': 'volume-a14c6450-6baa-4a58-b546-e0f297f92cfe', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac48176-47eb-4b5c-9964-8fae553b0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac48176-47eb-4b5c-9964-8fae553b0574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a379f0a0-4eb2-4370-adb8-d8c755177b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume a14c6450-6baa-4a58-b546-e0f297f92cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14c6450-6baa-4a58-b546-e0f297f92cfe', 'volume_size': 1}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e 1073741824" returned: 0 in 0.535s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:18 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e
Apr 06 16:56:18 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (e10d8b2c-8255-4f18-a0a9-1bfeec8dd630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293d05f0-90b3-4ee0-b414-5317c2cf48a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293d05f0-90b3-4ee0-b414-5317c2cf48a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-433717892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080b7819-1182-42a7-ba2d-f36cc0e65eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:18Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85be7b95-b2aa-46bf-85db-e7be4b0e9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85be7b95-b2aa-46bf-85db-e7be4b0e9acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe558643-8282-4749-b84a-78449dd29d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe558643-8282-4749-b84a-78449dd29d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080b7819-1182-42a7-ba2d-f36cc0e65eea', 'volume_name': 'volume-080b7819-1182-42a7-ba2d-f36cc0e65eea', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88837f6d-43ed-45ad-90ab-4e4166891cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88837f6d-43ed-45ad-90ab-4e4166891cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320dc385-e648-4d32-8d19-564a4052f4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume 080b7819-1182-42a7-ba2d-f36cc0e65eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080b7819-1182-42a7-ba2d-f36cc0e65eea', 'volume_size': 1}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (b7a1fbc7-1ee6-472d-87bd-3ef05a20374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ce10a-a4dc-4a77-89ef-b32f6b9d9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ce10a-a4dc-4a77-89ef-b32f6b9d9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582524495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53040e46-1217-43b6-bb40-eafdacd74c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:19Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab7b4e3-41f5-4c97-b2a6-9b2cd5f6f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab7b4e3-41f5-4c97-b2a6-9b2cd5f6f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ff43d2-56e6-4096-a486-30060b406f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ff43d2-56e6-4096-a486-30060b406f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53040e46-1217-43b6-bb40-eafdacd74c8d', 'volume_name': 'volume-53040e46-1217-43b6-bb40-eafdacd74c8d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c3f45b-c8d4-4ee6-846f-94e33c9a6834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c3f45b-c8d4-4ee6-846f-94e33c9a6834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c602471-8257-47a1-a1ed-afad6b28b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume 53040e46-1217-43b6-bb40-eafdacd74c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53040e46-1217-43b6-bb40-eafdacd74c8d', 'volume_size': 1}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:18 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.692s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b44a77c-5a16-4c36-a313-db1ac076ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a66598-4e2c-4053-b825-b3a19ed4872e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e265ba3-9fd0-47b7-80d4-f364d86520d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (8e6bb6cc-1973-4eff-aff3-b3625c073531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2633cf30-ebdc-4a5d-ae70-f735bc4a44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2633cf30-ebdc-4a5d-ae70-f735bc4a44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1525947501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9cb468-b31e-428f-ba36-0acbfefed75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:19Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6c774e-7e41-4a57-b4e2-77b69fdc3c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6c774e-7e41-4a57-b4e2-77b69fdc3c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de0b756-2884-412f-88a8-6364dcaed398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de0b756-2884-412f-88a8-6364dcaed398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9cb468-b31e-428f-ba36-0acbfefed75b', 'volume_name': 'volume-3e9cb468-b31e-428f-ba36-0acbfefed75b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3431ea73-d6e7-4ae3-9084-0966584f2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3431ea73-d6e7-4ae3-9084-0966584f2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07550426-2eff-4581-9c7e-440693f406a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume 3e9cb468-b31e-428f-ba36-0acbfefed75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9cb468-b31e-428f-ba36-0acbfefed75b', 'volume_size': 1}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Creating offline snapshot 1c6a765f-29d1-4a9a-ae86-53b73b039bf5 of volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:56:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Volume volume-42a66598-4e2c-4053-b825-b3a19ed4872e (42a66598-4e2c-4053-b825-b3a19ed4872e): created successfully
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e265ba3-9fd0-47b7-80d4-f364d86520d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Flow 'volume_create_manager' (cc20183d-1a96-47f0-8eaf-1fb2b39e700b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bbe2ad-5019-4f08-a947-b1dd5385a67a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:18 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2c1c439c-4d79-43b4-9963-ab46d91cc427 tempest-GroupsTest-1151299146 None] Created volume successfully.
Apr 06 16:56:19 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:19 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (1a7607f9-d784-45a5-9d92-e7ed3016372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4334d2-736e-4657-b1ed-4024d140a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4334d2-736e-4657-b1ed-4024d140a826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-714861854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74e7804-d150-4e4d-9661-06188078854c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:19Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bead60-b0ef-4342-b8d9-440efcc0ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bead60-b0ef-4342-b8d9-440efcc0ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988b6d4b-fc24-4638-a1c0-3e7469358500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988b6d4b-fc24-4638-a1c0-3e7469358500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74e7804-d150-4e4d-9661-06188078854c', 'volume_name': 'volume-b74e7804-d150-4e4d-9661-06188078854c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7fa4ef-e617-41ce-9f57-398e1ccc305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7fa4ef-e617-41ce-9f57-398e1ccc305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbcdfe8-a086-46a4-bdad-61ce0fc09f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:19 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume b74e7804-d150-4e4d-9661-06188078854c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74e7804-d150-4e4d-9661-06188078854c', 'volume_size': 1}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:19 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.463s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:19 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 1G
Apr 06 16:56:19 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Acquiring lock "cinder-quobyte-42a66598-4e2c-4053-b825-b3a19ed4872e" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Lock "cinder-quobyte-42a66598-4e2c-4053-b825-b3a19ed4872e" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af96dc0-c1e5-485f-a218-fbbcd9a75527]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:19 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 1G" returned: 0 in 0.546s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:20 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5
Apr 06 16:56:20 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:20 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e
Apr 06 16:56:20 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:20 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:20 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 is being set with open permissions: ugo+rw
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:20 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5
Apr 06 16:56:20 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:20 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e" returned: 0 in 0.498s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:20 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e
Apr 06 16:56:20 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:20 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157193880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14c6450-6baa-4a58-b546-e0f297f92cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:18Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating volume a14c6450-6baa-4a58-b546-e0f297f92cfe {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:20 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:20 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-42a66598-4e2c-4053-b825-b3a19ed4872e" returned: 0 in 0.408s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:20 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe 1073741824
Apr 06 16:56:20 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:20 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f595320f-7775-4cd1-9cec-a64fc8ff8123 tempest-VolumesSnapshotListTestJSON-1164068656 None] Create snapshot completed successfully
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Lock "cinder-quobyte-42a66598-4e2c-4053-b825-b3a19ed4872e" released by "delete_volume" :: held 0.931s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Created reservations ['44f376cd-99a8-4177-ba84-fc006441a3b9'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:20 devstack cinder-volume[82421]: WARNING cinder.quota [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1549382922 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1549382922, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:20 devstack cinder-volume[82421]: WARNING cinder.quota [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1549382922 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1549382922, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Created reservations ['e3bb9bca-1ff2-487a-8f73-f965d497c46b', '8f4e928d-2da0-4199-9179-d741d4e08834', '373a0100-ccf3-4084-85ab-239dee7c2f04', '26c898fa-cd8f-45c8-9af9-1c47e0da353b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:21 devstack sudo[89201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:21 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Created reservations ['661c0d69-fe46-49f8-b382-7a1ebdec949e'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:21 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:21 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:21 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe 1073741824" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:21 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe
Apr 06 16:56:21 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:21 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.448s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ec708b03-e015-4337-a4a1-b14cace301f2 tempest-GroupsTest-1151299146 None] Delete group completed successfully.
Apr 06 16:56:21 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.453s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a56893c3-6a9e-40ff-9cde-97c95c63aef0 tempest-GroupsTest-1151299146 None] Delete group completed successfully.
Apr 06 16:56:21 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe" returned: 0 in 0.421s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.223s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-433717892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080b7819-1182-42a7-ba2d-f36cc0e65eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:18Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating volume 080b7819-1182-42a7-ba2d-f36cc0e65eea {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:21 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a379f0a0-4eb2-4370-adb8-d8c755177b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14c6450-6baa-4a58-b546-e0f297f92cfe', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300ce9e4-6149-4e03-9eb4-a50c72bda53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:21 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea 1073741824
Apr 06 16:56:21 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:21 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume volume-a14c6450-6baa-4a58-b546-e0f297f92cfe (a14c6450-6baa-4a58-b546-e0f297f92cfe): created successfully
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300ce9e4-6149-4e03-9eb4-a50c72bda53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (19adf4e1-8e64-4727-a93e-f08c51359915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-783a046c-e815-4605-9ea9-812f40381f56 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created volume successfully.
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-1c6a765f-29d1-4a9a-ae86-53b73b039bf5-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-1c6a765f-29d1-4a9a-ae86-53b73b039bf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-1c6a765f-29d1-4a9a-ae86-53b73b039bf5" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-1c6a765f-29d1-4a9a-ae86-53b73b039bf5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Deleting offline snapshot 1c6a765f-29d1-4a9a-ae86-53b73b039bf5 of volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] snapshot_file for this snap is: volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8728cb83-674a-4709-b036-815c1a4775d1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:22 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5
Apr 06 16:56:22 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:22 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea 1073741824" returned: 0 in 0.540s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=189,cinder:UPDATE=202,cinder:INSERT=58,cinder:DELETE=18 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=207,cinder:UPDATE=231,cinder:INSERT=46,cinder:DELETE=12 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:22 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea
Apr 06 16:56:22 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:22 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5" returned: 0 in 0.505s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25e40bf-04db-4c45-be49-6418e7ee799d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9bdaf2da-ca98-432c-8d0b-8c8c6d640a23 tempest-GroupsTest-1151299146 None] Group tempest-GroupsTest-Group-1758815998: creating
Apr 06 16:56:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9bdaf2da-ca98-432c-8d0b-8c8c6d640a23 tempest-GroupsTest-1151299146 None] Group tempest-GroupsTest-Group-1758815998: created successfully
Apr 06 16:56:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9bdaf2da-ca98-432c-8d0b-8c8c6d640a23 tempest-GroupsTest-1151299146 None] Create group completed successfully.
Apr 06 16:56:22 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:22 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:22 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.069s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582524495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53040e46-1217-43b6-bb40-eafdacd74c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:19Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating volume 53040e46-1217-43b6-bb40-eafdacd74c8d {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:22 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320dc385-e648-4d32-8d19-564a4052f4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080b7819-1182-42a7-ba2d-f36cc0e65eea', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:22 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d 1073741824
Apr 06 16:56:22 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097cca6-0837-4fe0-9a31-4624f9a57aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:22 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume volume-080b7819-1182-42a7-ba2d-f36cc0e65eea (080b7819-1182-42a7-ba2d-f36cc0e65eea): created successfully
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097cca6-0837-4fe0-9a31-4624f9a57aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:22 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (e10d8b2c-8255-4f18-a0a9-1bfeec8dd630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d79003f8-15be-4ecb-ba53-077438b94c7e tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created volume successfully.
Apr 06 16:56:23 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:23 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5
Apr 06 16:56:23 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:23 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d 1073741824" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:23 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d
Apr 06 16:56:23 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:23 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5" returned: 0 in 0.493s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:23 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5
Apr 06 16:56:23 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:23 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d" returned: 0 in 0.445s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.813s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1525947501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9cb468-b31e-428f-ba36-0acbfefed75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:19Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating volume 3e9cb468-b31e-428f-ba36-0acbfefed75b {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:23 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:23 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b 1073741824
Apr 06 16:56:23 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c602471-8257-47a1-a1ed-afad6b28b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53040e46-1217-43b6-bb40-eafdacd74c8d', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda07494-0dca-4e75-a1a9-2b18eb822e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume volume-53040e46-1217-43b6-bb40-eafdacd74c8d (53040e46-1217-43b6-bb40-eafdacd74c8d): created successfully
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda07494-0dca-4e75-a1a9-2b18eb822e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (b7a1fbc7-1ee6-472d-87bd-3ef05a20374f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:23 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f26fdc99-fed7-4b26-90c7-6da0320c65b4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created volume successfully.
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Flow 'volume_create_manager' (1195b0a2-0c86-4847-95f4-9488632c694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f918e2c-75bc-4f5a-bc6e-c2a56665b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f918e2c-75bc-4f5a-bc6e-c2a56665b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863044980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28d27f79-1e57-428f-ab36-8dae66d53e23,host='devstack@QuobyteHD#QuobyteHD',id=2fa9fcd8-aca9-469f-9f8f-9200fa145ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2006c48318694941ab4e192253151822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:24Z,use_quota=True,user_id='6564e5a8aad049a9b521681cda83623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf1ff1f-bfbf-4ae9-be1b-c792b3343977),volume_type_id=daf1ff1f-bfbf-4ae9-be1b-c792b3343977)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:23 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a08123-0742-4309-b206-d41683f2f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a08123-0742-4309-b206-d41683f2f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f770bf-ff1b-4599-b0cd-076fde393860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f770bf-ff1b-4599-b0cd-076fde393860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa9fcd8-aca9-469f-9f8f-9200fa145ee7', 'volume_name': 'volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f9adfb-07f3-439c-836e-6e30818b4d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f9adfb-07f3-439c-836e-6e30818b4d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2414acf2-27b8-41d2-9327-9794332a4c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Volume 2fa9fcd8-aca9-469f-9f8f-9200fa145ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7', 'volume_size': 1}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.1c6a765f-29d1-4a9a-ae86-53b73b039bf5" returned: 0 in 0.473s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-1c6a765f-29d1-4a9a-ae86-53b73b039bf5" released by "_delete_snapshot" :: held 1.993s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" released by "delete_snapshot" :: held 2.005s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Created reservations ['fe0c5a16-3e98-41b8-afd8-3f800a3dfcb8', '28a78f2b-0f21-4f84-a24d-e8cdbccf70b9', 'f3a26f39-d721-47bc-b518-c3711facda40', '50a0e061-7281-499b-b4dc-b5b03818cb4b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Delete snapshot completed successfully.
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-3ad6cfa6-e197-4289-b3ec-33be841b6f41 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-1c6a765f-29d1-4a9a-ae86-53b73b039bf5-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:24 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b 1073741824" returned: 0 in 0.494s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:24 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b
Apr 06 16:56:24 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-b30100e3-70bc-46f0-8a37-2ad1d4a9c441-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-b30100e3-70bc-46f0-8a37-2ad1d4a9c441-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-b30100e3-70bc-46f0-8a37-2ad1d4a9c441" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-b30100e3-70bc-46f0-8a37-2ad1d4a9c441" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Deleting offline snapshot b30100e3-70bc-46f0-8a37-2ad1d4a9c441 of volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] snapshot_file for this snap is: volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399f330-e4db-4b63-80b3-ab7667abbb89]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:24 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:24 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:24 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b" returned: 0 in 0.430s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.570s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-714861854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74e7804-d150-4e4d-9661-06188078854c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62be38c9e0694bc2b613f957ef4732ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:19Z,use_quota=True,user_id='50e650c015e54e619b5b3f732ee1df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Creating volume b74e7804-d150-4e4d-9661-06188078854c {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:24 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:24 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c 1073741824
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07550426-2eff-4581-9c7e-440693f406a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9cb468-b31e-428f-ba36-0acbfefed75b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:24 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67763892-8662-4227-85c0-a4aa9a93c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:24 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume volume-3e9cb468-b31e-428f-ba36-0acbfefed75b (3e9cb468-b31e-428f-ba36-0acbfefed75b): created successfully
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67763892-8662-4227-85c0-a4aa9a93c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (8e6bb6cc-1973-4eff-aff3-b3625c073531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b657a60b-9e2e-4996-aed8-28e9872d6acd tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created volume successfully.
Apr 06 16:56:24 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be2456c-1da6-46d4-8ba6-5333ad1c3dff]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:24 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:24 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:25 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c 1073741824" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:25 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c
Apr 06 16:56:25 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:25 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:25 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:25 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:25 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=28d27f79-1e57-428f-ab36-8dae66d53e23,created_at=2026-04-06T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863044980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28d27f79-1e57-428f-ab36-8dae66d53e23,host='devstack@QuobyteHD#QuobyteHD',id=2fa9fcd8-aca9-469f-9f8f-9200fa145ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2006c48318694941ab4e192253151822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:24Z,use_quota=True,user_id='6564e5a8aad049a9b521681cda83623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf1ff1f-bfbf-4ae9-be1b-c792b3343977),volume_type_id=daf1ff1f-bfbf-4ae9-be1b-c792b3343977)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Creating volume 2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:25 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbcdfe8-a086-46a4-bdad-61ce0fc09f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74e7804-d150-4e4d-9661-06188078854c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2c1510-de2c-40f8-a878-dc8c0aeeec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:25 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 1073741824
Apr 06 16:56:25 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Volume volume-b74e7804-d150-4e4d-9661-06188078854c (b74e7804-d150-4e4d-9661-06188078854c): created successfully
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2c1510-de2c-40f8-a878-dc8c0aeeec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Flow 'volume_create_manager' (1a7607f9-d784-45a5-9d92-e7ed3016372f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d330c130-9b3a-407e-83e6-15c1002687ba tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created volume successfully.
Apr 06 16:56:25 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:25 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441
Apr 06 16:56:25 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:26 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 1073741824" returned: 0 in 0.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:26 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7
Apr 06 16:56:26 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:26 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.b30100e3-70bc-46f0-8a37-2ad1d4a9c441" returned: 0 in 0.413s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-b30100e3-70bc-46f0-8a37-2ad1d4a9c441" released by "_delete_snapshot" :: held 1.859s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" released by "delete_snapshot" :: held 1.874s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Created reservations ['776577f1-9303-4c83-bcef-7919c9984a00', '464417a4-303f-42fc-a35e-bbe3e3634220', 'd7140d7e-ba34-4e18-bba4-b31846a8599a', 'f7f2b3d2-0891-4f7b-992b-7608b3e8782b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Delete snapshot completed successfully.
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-1c4637ea-6689-4d7c-9fcb-a7ac0057b866 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-b30100e3-70bc-46f0-8a37-2ad1d4a9c441-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-a589d378-a9a5-4356-ac63-f4ce4665e9d2-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-a589d378-a9a5-4356-ac63-f4ce4665e9d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-a589d378-a9a5-4356-ac63-f4ce4665e9d2" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-a589d378-a9a5-4356-ac63-f4ce4665e9d2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:26 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Deleting offline snapshot a589d378-a9a5-4356-ac63-f4ce4665e9d2 of volume cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] snapshot_file for this snap is: volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7" returned: 0 in 0.407s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc07dde-2cb7-4767-9f10-9b63947f0b63]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2414acf2-27b8-41d2-9327-9794332a4c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44824410-90a9-485b-8fbb-ff02859ad816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Volume volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 (2fa9fcd8-aca9-469f-9f8f-9200fa145ee7): created successfully
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44824410-90a9-485b-8fbb-ff02859ad816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Flow 'volume_create_manager' (1195b0a2-0c86-4847-95f4-9488632c694d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-743cd67b-f329-4ef9-845d-709c665aba8d tempest-GroupsTest-1151299146 None] Created volume successfully.
Apr 06 16:56:26 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:26 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-b74e7804-d150-4e4d-9661-06188078854c-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-b74e7804-d150-4e4d-9661-06188078854c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-b74e7804-d150-4e4d-9661-06188078854c" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-b74e7804-d150-4e4d-9661-06188078854c" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e78e3-0a19-433b-88d4-30b6813a26c3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:26 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c
Apr 06 16:56:26 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:26 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f2a70f-e0c8-4574-8408-156c15e475df]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:27 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835
Apr 06 16:56:27 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:27 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:27 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c
Apr 06 16:56:27 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Flow 'volume_create_manager' (9656f499-bd68-4f3f-97a3-753211142edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8a4e81-859d-46f8-96b7-ede0da7c3a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8a4e81-859d-46f8-96b7-ede0da7c3a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025521621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28d27f79-1e57-428f-ab36-8dae66d53e23,host='devstack@QuobyteHD#QuobyteHD',id=7478e06b-2b32-451e-b690-8e4965063a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2006c48318694941ab4e192253151822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:27Z,use_quota=True,user_id='6564e5a8aad049a9b521681cda83623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf1ff1f-bfbf-4ae9-be1b-c792b3343977),volume_type_id=daf1ff1f-bfbf-4ae9-be1b-c792b3343977)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db550758-094a-4a3b-b6d2-168f51e86241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db550758-094a-4a3b-b6d2-168f51e86241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967a1a55-d4e4-45a7-90f7-12c14d784b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967a1a55-d4e4-45a7-90f7-12c14d784b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7478e06b-2b32-451e-b690-8e4965063a4b', 'volume_name': 'volume-7478e06b-2b32-451e-b690-8e4965063a4b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525eb9d1-e642-44f8-8807-e2640c34d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525eb9d1-e642-44f8-8807-e2640c34d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be02ed86-0963-4c60-a107-9426e8a14c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:27 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Volume 7478e06b-2b32-451e-b690-8e4965063a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7478e06b-2b32-451e-b690-8e4965063a4b', 'volume_size': 1}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=28d27f79-1e57-428f-ab36-8dae66d53e23,created_at=2026-04-06T14:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025521621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=28d27f79-1e57-428f-ab36-8dae66d53e23,host='devstack@QuobyteHD#QuobyteHD',id=7478e06b-2b32-451e-b690-8e4965063a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2006c48318694941ab4e192253151822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:27Z,use_quota=True,user_id='6564e5a8aad049a9b521681cda83623a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf1ff1f-bfbf-4ae9-be1b-c792b3343977),volume_type_id=daf1ff1f-bfbf-4ae9-be1b-c792b3343977)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Creating volume 7478e06b-2b32-451e-b690-8e4965063a4b {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:27 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:27 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b 1073741824
Apr 06 16:56:27 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:27 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" returned: 0 in 0.523s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:27 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:27 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:27 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b74e7804-d150-4e4d-9661-06188078854c" returned: 0 in 0.407s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-b74e7804-d150-4e4d-9661-06188078854c" released by "delete_volume" :: held 0.902s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['a643792a-adeb-41f8-9fa4-2b8f429b5451', '8e3769e7-a694-4e34-ab5e-8aa892a4ea79', '25a984f4-022e-4b54-80b3-58dbfcc653a5', '7b5dcaad-4920-4ac1-85f2-7753923f4f84'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:27 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:27 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-3e9cb468-b31e-428f-ba36-0acbfefed75b-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-3e9cb468-b31e-428f-ba36-0acbfefed75b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-3e9cb468-b31e-428f-ba36-0acbfefed75b" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-3e9cb468-b31e-428f-ba36-0acbfefed75b" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f4f66b-183e-4569-ba40-fb9de2ecaf4d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:27 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b 1073741824" returned: 0 in 0.521s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:28 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b
Apr 06 16:56:28 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:28 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.472s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:28 devstack sudo[89324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2
Apr 06 16:56:28 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:28 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b
Apr 06 16:56:28 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:28 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:28 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleted volume successfully.
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-efde7c63-4b8b-4702-8eba-b562609d97a8 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-b74e7804-d150-4e4d-9661-06188078854c-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:28 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:28 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b
Apr 06 16:56:28 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:28 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835.a589d378-a9a5-4356-ac63-f4ce4665e9d2" returned: 0 in 0.419s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:28 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-a589d378-a9a5-4356-ac63-f4ce4665e9d2" released by "_delete_snapshot" :: held 1.941s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be02ed86-0963-4c60-a107-9426e8a14c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7478e06b-2b32-451e-b690-8e4965063a4b', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0873b9-b14c-4bd3-8f41-dea869d912d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" released by "delete_snapshot" :: held 1.964s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:28 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Volume volume-7478e06b-2b32-451e-b690-8e4965063a4b (7478e06b-2b32-451e-b690-8e4965063a4b): created successfully
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0873b9-b14c-4bd3-8f41-dea869d912d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Flow 'volume_create_manager' (9656f499-bd68-4f3f-97a3-753211142edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:28 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-761e2609-55b1-4e89-a09e-ed3d46699cb1 tempest-GroupsTest-1151299146 None] Created volume successfully.
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Created reservations ['172919f5-4c2a-436c-80d9-b7c46f73764e', '8dc60366-b4b6-4645-bcc4-fc299a592644', '3224436c-9ffc-4f30-b41d-364d28325bde', 'f5f33f20-dbd3-447a-9657-935cdae2897f'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:28 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Delete snapshot completed successfully.
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2282d136-8540-438c-a1dc-2794a82884ff tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-a589d378-a9a5-4356-ac63-f4ce4665e9d2-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10911d2-86bd-4344-955f-b1e941015d30]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:28 devstack sudo[89335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835
Apr 06 16:56:28 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:28 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3e9cb468-b31e-428f-ba36-0acbfefed75b" returned: 0 in 0.447s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-3e9cb468-b31e-428f-ba36-0acbfefed75b" released by "delete_volume" :: held 0.967s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['143881e8-a2b3-488a-b7cc-18cf4ae13407', '94c33b26-7200-482f-bb6e-2364dac33cb1', '09fbebc3-b4da-4ae3-8d20-b469fb4d01a7', '3c7a33dc-8d96-4435-a260-b815793e8181'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:28 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:28 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-53040e46-1217-43b6-bb40-eafdacd74c8d-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:28 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-53040e46-1217-43b6-bb40-eafdacd74c8d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-53040e46-1217-43b6-bb40-eafdacd74c8d" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-53040e46-1217-43b6-bb40-eafdacd74c8d" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c9c82-f959-453f-9c93-d40257681642]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:29 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d
Apr 06 16:56:29 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:29 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:29 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835
Apr 06 16:56:29 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:29 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.413s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleted volume successfully.
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ab0c61a2-35bb-4312-94f4-bb9db228256c tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-3e9cb468-b31e-428f-ba36-0acbfefed75b-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:29 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d" returned: 0 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:29 devstack sudo[89351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d
Apr 06 16:56:29 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:29 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" returned: 0 in 0.423s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-quobyte-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835" released by "delete_volume" :: held 0.922s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Created reservations ['3247684a-ebe9-43ac-897d-83f1ab4d37b3', '15817d45-7abf-43a0-983f-9b4d602a2bb7', 'b7f7e0e1-fe6f-411f-8271-0a54eed3692a', '241d53d2-490d-4b84-85a1-d2deb13cc1a2'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-279359ee-650c-44e3-96e8-255deddc7fc9 tempest-GroupsTest-1151299146 None] Update group completed successfully.
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:29 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:29 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:29 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-53040e46-1217-43b6-bb40-eafdacd74c8d" returned: 0 in 0.434s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-53040e46-1217-43b6-bb40-eafdacd74c8d" released by "delete_volume" :: held 0.897s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['d0fac845-917d-4aea-9d27-a240ec80675a', '007c7aef-8078-48fb-aac9-a28108fbe925', 'ede824bb-979e-45ed-8c0b-dd2f0654e549', '22bc3648-1a73-4661-b685-43cb02d9c91d'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:30 devstack sudo[89357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:30 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-080b7819-1182-42a7-ba2d-f36cc0e65eea-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-080b7819-1182-42a7-ba2d-f36cc0e65eea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:30 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Deleted volume successfully.
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e6a05bac-9c8e-4241-85b1-56727b4c1396 tempest-VolumesSnapshotListTestJSON-1164068656 None] Lock "cinder-cfe5e679-bc0b-4e57-b647-cdbd3f3bd835-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-080b7819-1182-42a7-ba2d-f36cc0e65eea" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-080b7819-1182-42a7-ba2d-f36cc0e65eea" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d6d856-63ff-4171-a0c3-7616eaa12ee5]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:30 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea
Apr 06 16:56:30 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:30 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.482s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleted volume successfully.
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-87104aed-e93e-48c1-bfc7-901688a5fa64 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-53040e46-1217-43b6-bb40-eafdacd74c8d-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:30 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea" returned: 0 in 0.604s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:30 devstack sudo[89367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea
Apr 06 16:56:30 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cbd43fa5-d11d-4250-a3f1-5f4fddbb67a0 tempest-GroupsTest-1151299146 None] Update group completed successfully.
Apr 06 16:56:31 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-080b7819-1182-42a7-ba2d-f36cc0e65eea" returned: 0 in 0.426s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-080b7819-1182-42a7-ba2d-f36cc0e65eea" released by "delete_volume" :: held 1.057s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['31450099-529d-43b6-bcd2-c03ea336c479', '6066a03a-a073-4b6a-9dcd-6ea70eec8b26', '05194090-00c3-4c44-af3e-bb7d1225b7be', '8e91877e-de63-4ee1-9bbe-ad4ed05592f1'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:31 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:31 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (fdc6b029-b0c1-42a9-8d80-ac60d741fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73051bf-44b5-4b16-82c9-b62da8256e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73051bf-44b5-4b16-82c9-b62da8256e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-320754992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2f4a14-c77c-4918-9dc8-7b24f085d932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996392e3-44b8-46fb-a85a-b8d2b74cc1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996392e3-44b8-46fb-a85a-b8d2b74cc1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a518e7c-d746-44f5-9fcd-d2806e4440e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a518e7c-d746-44f5-9fcd-d2806e4440e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2f4a14-c77c-4918-9dc8-7b24f085d932', 'volume_name': 'volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6178a58-ef41-44fb-a65b-e0529ae29d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6178a58-ef41-44fb-a65b-e0529ae29d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc9e9e7-1a0d-492e-9d44-59eff3bfc6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Volume 1e2f4a14-c77c-4918-9dc8-7b24f085d932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932', 'volume_size': 1}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-320754992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2f4a14-c77c-4918-9dc8-7b24f085d932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Creating volume 1e2f4a14-c77c-4918-9dc8-7b24f085d932 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:31 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:31 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.475s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:31 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleted volume successfully.
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5dbb9965-d20e-4ae5-b155-6ca51503bca5 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-080b7819-1182-42a7-ba2d-f36cc0e65eea-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:31 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 1073741824
Apr 06 16:56:31 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (3839f6d5-16e1-4906-8ca8-ae1ce40d90fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1632e415-5f46-456f-af03-4c15a9a1aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1632e415-5f46-456f-af03-4c15a9a1aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1203764198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e75b5-e397-48c2-973d-c64aeca5c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e75b5-e397-48c2-973d-c64aeca5c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0277018-5228-42ee-9a69-cdd1d5a0a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0277018-5228-42ee-9a69-cdd1d5a0a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6', 'volume_name': 'volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c91394d-7ba9-4d9d-9208-bb4ce02556b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c91394d-7ba9-4d9d-9208-bb4ce02556b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea421723-aecb-41bc-952d-e1854e254541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:31 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Volume 042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6', 'volume_size': 1}
Apr 06 16:56:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (567e0584-d421-4381-8ae1-fe79ee3de1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcb9fef-6867-4a5a-9b5b-06a8b258b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcb9fef-6867-4a5a-9b5b-06a8b258b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1053234591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d04ef-d627-4e6e-94dd-2ad1323c7f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad505f3f-d101-40c6-8f94-6e0b0c6af62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad505f3f-d101-40c6-8f94-6e0b0c6af62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ecc48b-39c1-42bc-b7d7-ae2df6d69089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ecc48b-39c1-42bc-b7d7-ae2df6d69089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d04ef-d627-4e6e-94dd-2ad1323c7f6a', 'volume_name': 'volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac66c337-6795-469f-b2a9-ec27fd222685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac66c337-6795-469f-b2a9-ec27fd222685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b41449-3409-48ad-8495-ca418795c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Volume a01d04ef-d627-4e6e-94dd-2ad1323c7f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a', 'volume_size': 1}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Acquiring lock "cinder-quobyte-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Lock "cinder-quobyte-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7" acquired by "delete_volume" :: waited 0.028s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (7dd9d65f-6593-4472-9ccf-b1d5c12ffdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbbef5b-9c57-4ddf-8d34-dd3bda81586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d3399a-4e2f-49c0-a726-636cf51df796]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbbef5b-9c57-4ddf-8d34-dd3bda81586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035462622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceace1d9-05a9-486f-b4cc-c0849ffe97bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef1e5ee-1584-4fe4-bdf8-cf8a6dcde258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef1e5ee-1584-4fe4-bdf8-cf8a6dcde258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb2b9de-443b-4ac0-a44b-54b28fdcec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb2b9de-443b-4ac0-a44b-54b28fdcec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceace1d9-05a9-486f-b4cc-c0849ffe97bd', 'volume_name': 'volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fb99ad-8cf3-4d0f-80ee-267d73b8d585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fb99ad-8cf3-4d0f-80ee-267d73b8d585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1ae0cd-5634-4ecf-b69e-3f02d63a35da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Volume ceace1d9-05a9-486f-b4cc-c0849ffe97bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd', 'volume_size': 1}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-a14c6450-6baa-4a58-b546-e0f297f92cfe-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-a14c6450-6baa-4a58-b546-e0f297f92cfe-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-a14c6450-6baa-4a58-b546-e0f297f92cfe" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-a14c6450-6baa-4a58-b546-e0f297f92cfe" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2989c6b2-8f1a-4b50-bb9b-9267c4419882]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:32 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 1073741824" returned: 0 in 0.702s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:32 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7
Apr 06 16:56:32 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:32 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932
Apr 06 16:56:32 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:32 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:32 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (8cf8faf0-1d6e-42a0-8a0e-041e417c0c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e12a49-e87d-4db4-a991-763c771a5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e12a49-e87d-4db4-a991-763c771a5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-6725914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bc33c2-d318-4c11-84cb-f4b4f9cea76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341fbc5f-fe41-405b-b10c-a25682fb57af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341fbc5f-fe41-405b-b10c-a25682fb57af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa48b01-b675-44ee-bc77-2876a746d115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa48b01-b675-44ee-bc77-2876a746d115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bc33c2-d318-4c11-84cb-f4b4f9cea76a', 'volume_name': 'volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a799055-f21f-4ef7-999c-bcd4975058ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a799055-f21f-4ef7-999c-bcd4975058ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66349099-72b0-4e77-b833-3e9b92fe16b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Volume 98bc33c2-d318-4c11-84cb-f4b4f9cea76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a', 'volume_size': 1}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:32 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7" returned: 0 in 0.539s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:32 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932" returned: 0 in 0.411s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:32 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1203764198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Creating volume 042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:32 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7
Apr 06 16:56:32 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:32 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc9e9e7-1a0d-492e-9d44-59eff3bfc6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4cc67c-e46e-4ccd-9cb7-f745a59c889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:32 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 1073741824
Apr 06 16:56:32 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe" returned: 0 in 0.503s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:32 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Volume volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 (1e2f4a14-c77c-4918-9dc8-7b24f085d932): created successfully
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4cc67c-e46e-4ccd-9cb7-f745a59c889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:32 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe
Apr 06 16:56:32 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (fdc6b029-b0c1-42a9-8d80-ac60d741fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:32 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:32 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5d6c1c05-2a2a-4038-8327-ffe2d8fca57f tempest-CreateVolumesFromImageTest-146628854 None] Created volume successfully.
Apr 06 16:56:33 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Lock "cinder-quobyte-2fa9fcd8-aca9-469f-9f8f-9200fa145ee7" released by "delete_volume" :: held 1.075s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Acquiring lock "cinder-quobyte-7478e06b-2b32-451e-b690-8e4965063a4b" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Lock "cinder-quobyte-7478e06b-2b32-451e-b690-8e4965063a4b" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb56bd3f-979f-4d2b-ba10-3b588b71c360]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:33 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 1073741824" returned: 0 in 0.504s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:33 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a14c6450-6baa-4a58-b546-e0f297f92cfe" returned: 0 in 0.489s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:33 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b
Apr 06 16:56:33 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-a14c6450-6baa-4a58-b546-e0f297f92cfe" released by "delete_volume" :: held 1.021s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:33 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6
Apr 06 16:56:33 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['6e66bbcd-4c03-4062-afbc-7937d40a655b', '85578bfa-e0f9-47db-98d7-2b5ba0a9ef61', '74757cb2-3ae6-4868-b8cc-91be9ba1ab8a', '0dd47ff3-357f-424d-95fd-f319e2417765'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:33 devstack sudo[89407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:33 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:33 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b" returned: 0 in 0.468s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:33 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b
Apr 06 16:56:33 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:33 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1053234591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d04ef-d627-4e6e-94dd-2ad1323c7f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Creating volume a01d04ef-d627-4e6e-94dd-2ad1323c7f6a {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:33 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea421723-aecb-41bc-952d-e1854e254541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4f23c3-2ae6-4236-ba75-5e48fe4b7e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:33 devstack sudo[89416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a 1073741824
Apr 06 16:56:33 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Volume volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 (042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6): created successfully
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4f23c3-2ae6-4236-ba75-5e48fe4b7e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (3839f6d5-16e1-4906-8ca8-ae1ce40d90fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9030e9fa-c877-40fa-9fe3-02350bd8d32c tempest-CreateVolumesFromImageTest-146628854 None] Created volume successfully.
Apr 06 16:56:33 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleted volume successfully.
Apr 06 16:56:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-03b5bbe8-cea6-4713-9ff4-3e13a9bdfa41 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-a14c6450-6baa-4a58-b546-e0f297f92cfe-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:34 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7478e06b-2b32-451e-b690-8e4965063a4b" returned: 0 in 0.401s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Lock "cinder-quobyte-7478e06b-2b32-451e-b690-8e4965063a4b" released by "delete_volume" :: held 0.894s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Created reservations ['8c7a96dc-0c53-48ed-ab96-e0ec89003374'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:34 devstack cinder-volume[82421]: WARNING cinder.quota [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1381381053 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1381381053, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:34 devstack cinder-volume[82421]: WARNING cinder.quota [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1381381053 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1381381053, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Created reservations ['3485e8bc-9d3a-4824-93b8-12683fc0dabe', 'bf675d83-e18c-4e47-8791-74f15cb8166f', 'e70c97d0-a75c-4862-833a-26945a6f60bf', '5b489450-bf66-4e78-88aa-bf0e36ae0d33'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Created reservations ['743a06a1-4eca-4832-9db7-cbac779d08f9', 'a88ec553-77f1-47ec-8e9a-f3e650a44d72', 'cd9081b6-2b44-40c7-91a1-8f62b2ef5ea7', 'e6c64389-5274-4aff-80df-15bfc0810be6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:34 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a 1073741824" returned: 0 in 0.482s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:34 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a
Apr 06 16:56:34 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:34 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:34 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-66d89d67-8882-4708-b6c9-46d6d0605323-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-66d89d67-8882-4708-b6c9-46d6d0605323-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-0f3000f3-03db-490f-8d38-88bb6574def7" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-0f3000f3-03db-490f-8d38-88bb6574def7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-66d89d67-8882-4708-b6c9-46d6d0605323" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-66d89d67-8882-4708-b6c9-46d6d0605323" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleting offline snapshot 66d89d67-8882-4708-b6c9-46d6d0605323 of volume 0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] snapshot_file for this snap is: volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[903894f0-afbc-46af-ba2f-4b07e22c5156]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:34 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323
Apr 06 16:56:34 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:34 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a" returned: 0 in 0.412s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035462622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceace1d9-05a9-486f-b4cc-c0849ffe97bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Creating volume ceace1d9-05a9-486f-b4cc-c0849ffe97bd {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:34 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b41449-3409-48ad-8495-ca418795c371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:34 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd 1073741824
Apr 06 16:56:34 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0625ca74-8689-4fc7-9925-6d848f7b0026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Volume volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a (a01d04ef-d627-4e6e-94dd-2ad1323c7f6a): created successfully
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0625ca74-8689-4fc7-9925-6d848f7b0026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (567e0584-d421-4381-8ae1-fe79ee3de1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5e75d546-9b16-42a0-9917-cc3ad7d76c94 tempest-CreateVolumesFromImageTest-146628854 None] Created volume successfully.
Apr 06 16:56:34 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.423s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:34 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-668a2c58-979d-4719-983d-bba8501c5a0f tempest-GroupsTest-1151299146 None] Delete group completed successfully.
Apr 06 16:56:35 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323" returned: 0 in 0.448s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3000f3-03db-490f-8d38-88bb6574def7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[464358dc-e6a5-4c77-8bb2-0f143d56b289]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:35 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7
Apr 06 16:56:35 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:35 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd 1073741824" returned: 0 in 0.479s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:35 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd
Apr 06 16:56:35 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:35 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:35 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323
Apr 06 16:56:35 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:35 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd" returned: 0 in 0.434s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.187s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-6725914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bc33c2-d318-4c11-84cb-f4b4f9cea76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a83c1b702e04a569d2f66689eb4a0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:32Z,use_quota=True,user_id='25565b31351047ff9af01a10afba6298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Creating volume 98bc33c2-d318-4c11-84cb-f4b4f9cea76a {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:35 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1ae0cd-5634-4ecf-b69e-3f02d63a35da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786f9655-d981-40f7-9d20-34bba5ae9064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:35 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a 1073741824
Apr 06 16:56:35 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:35 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Volume volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd (ceace1d9-05a9-486f-b4cc-c0849ffe97bd): created successfully
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786f9655-d981-40f7-9d20-34bba5ae9064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (7dd9d65f-6593-4472-9ccf-b1d5c12ffdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:35 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e0faa9cb-d8b7-4173-bea3-44ae4cbe959a tempest-CreateVolumesFromImageTest-146628854 None] Created volume successfully.
Apr 06 16:56:36 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323" returned: 0 in 0.565s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:36 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323
Apr 06 16:56:36 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:36 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a 1073741824" returned: 0 in 0.493s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:36 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a
Apr 06 16:56:36 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:36 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7.66d89d67-8882-4708-b6c9-46d6d0605323" returned: 0 in 0.421s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-66d89d67-8882-4708-b6c9-46d6d0605323" released by "_delete_snapshot" :: held 2.028s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-0f3000f3-03db-490f-8d38-88bb6574def7" released by "delete_snapshot" :: held 2.046s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['98fc9c27-1f31-4b15-989a-b97054db472a', '5e487f03-c6b1-4a70-9f37-bc2b1bf0af46', 'df5a2c44-25a4-43a4-a523-e748a5be2e93', '9abef8f2-c58f-46f3-a5be-682549f4aab9'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Delete snapshot completed successfully.
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8aa6ef63-b202-4ee3-8240-ade999914a9a tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-66d89d67-8882-4708-b6c9-46d6d0605323-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:36 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66349099-72b0-4e77-b833-3e9b92fe16b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818c6ee2-333d-4458-b543-a830e8e5848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:36 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Volume volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a (98bc33c2-d318-4c11-84cb-f4b4f9cea76a): created successfully
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818c6ee2-333d-4458-b543-a830e8e5848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Flow 'volume_create_manager' (8cf8faf0-1d6e-42a0-8a0e-041e417c0c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-7470d7fb-427d-416e-94d9-7e1f2d4b88e0 tempest-CreateVolumesFromImageTest-146628854 None] Created volume successfully.
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-98bc33c2-d318-4c11-84cb-f4b4f9cea76a-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-98bc33c2-d318-4c11-84cb-f4b4f9cea76a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-quobyte-98bc33c2-d318-4c11-84cb-f4b4f9cea76a" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-98bc33c2-d318-4c11-84cb-f4b4f9cea76a" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfca8f2-125b-48e6-bb6e-b97f3792ae67]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:37 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a
Apr 06 16:56:37 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:37 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a" returned: 0 in 0.462s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:37 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a
Apr 06 16:56:37 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-0f3000f3-03db-490f-8d38-88bb6574def7-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-0f3000f3-03db-490f-8d38-88bb6574def7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "cinder-quobyte-0f3000f3-03db-490f-8d38-88bb6574def7" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-0f3000f3-03db-490f-8d38-88bb6574def7" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef91120-ad15-4b56-8378-d8f98cf9c43f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:37 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-98bc33c2-d318-4c11-84cb-f4b4f9cea76a" returned: 0 in 0.473s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:37 devstack sudo[89470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7
Apr 06 16:56:37 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-98bc33c2-d318-4c11-84cb-f4b4f9cea76a" released by "delete_volume" :: held 0.975s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:37 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Created reservations ['77a6921c-d5d5-4e65-bb51-cf8441a8cf1f', '40958be8-18c3-4cc7-974c-782701438da1', '843452e1-4be6-43b7-be20-36acdc46f1fe', '58ada2c3-dfb1-46ab-be2c-68e234309a70'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:38 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:38 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-ceace1d9-05a9-486f-b4cc-c0849ffe97bd-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-ceace1d9-05a9-486f-b4cc-c0849ffe97bd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-quobyte-ceace1d9-05a9-486f-b4cc-c0849ffe97bd" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-ceace1d9-05a9-486f-b4cc-c0849ffe97bd" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dccb35-9608-4112-8796-3375d13b89f0]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:38 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd
Apr 06 16:56:38 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:38 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7" returned: 0 in 0.545s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:38 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7
Apr 06 16:56:38 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:38 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.514s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Deleted volume successfully.
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-018fac6e-6145-4455-ab77-f5089eb6923b tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-98bc33c2-d318-4c11-84cb-f4b4f9cea76a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:38 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d2b8bf04-41d1-4b2b-8650-7cd9f82b8a31 tempest-GroupsV320Test-2079515442 None] Group tempest-GroupsV320Test-Group-2137381967: creating
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd" returned: 0 in 0.504s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:38 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd
Apr 06 16:56:38 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d2b8bf04-41d1-4b2b-8650-7cd9f82b8a31 tempest-GroupsV320Test-2079515442 None] Group tempest-GroupsV320Test-Group-2137381967: created successfully
Apr 06 16:56:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d2b8bf04-41d1-4b2b-8650-7cd9f82b8a31 tempest-GroupsV320Test-2079515442 None] Create group completed successfully.
Apr 06 16:56:38 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0f3000f3-03db-490f-8d38-88bb6574def7" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-quobyte-0f3000f3-03db-490f-8d38-88bb6574def7" released by "delete_volume" :: held 1.018s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Created reservations ['e34a4963-f3c5-4ecb-b98f-5809d0f93af0', 'b2da5e09-8ae6-45c0-823c-6e4935c42567', '7224a746-44e1-4268-b5a1-de403376c68e', '7603dfb7-0a9e-48bd-be4a-4ea5421f55d3'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:38 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:38 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:39 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ceace1d9-05a9-486f-b4cc-c0849ffe97bd" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-ceace1d9-05a9-486f-b4cc-c0849ffe97bd" released by "delete_volume" :: held 0.910s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Created reservations ['9fd88d8d-bb3f-4106-a5ca-bad3c6c0a2c3', '8272c232-8126-4210-acc7-f47787c10698', '0bca0640-db00-43fc-a3bd-5451e326836e', 'b75c71d1-a43f-4e7f-b3f4-095ea1542f6a'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:39 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:39 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-quobyte-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb79c8-edcb-4e95-b90c-c3200b2a9566]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:39 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a
Apr 06 16:56:39 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:39 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.433s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Deleted volume successfully.
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e745d928-20a5-4c50-abb3-97a6c35886d4 tempest-CreateVolumesFromSnapshotTest-1716296422 None] Lock "cinder-0f3000f3-03db-490f-8d38-88bb6574def7-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:39 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.404s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Deleted volume successfully.
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-72681fc5-e663-4cd4-b1f5-e956da5f8258 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-ceace1d9-05a9-486f-b4cc-c0849ffe97bd-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:39 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:39 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a
Apr 06 16:56:39 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Created reservations ['39bc3f6d-f79a-4714-9d00-be402ecfb4e9'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:40 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:40 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:40 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a" returned: 0 in 0.445s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a" released by "delete_volume" :: held 0.959s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Created reservations ['696deb2a-8c03-47e5-ac6d-c23f451f5a6d', '6f241e50-90f2-41f5-9a82-c78568e3e507', '0668dc6d-3f08-4b33-904c-97ed01d7df91', 'e62c8ba8-5722-4bc3-9d38-a5caf72b7c7d'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:40 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:40 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-quobyte-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b930597f-771f-4f45-bb87-34134318ea69]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:40 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6
Apr 06 16:56:40 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:40 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8fc8e9e6-1e64-4793-a2d8-b4849c53323f tempest-GroupsV320Test-2079515442 None] Delete group completed successfully.
Apr 06 16:56:40 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:40 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Deleted volume successfully.
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48a0c65d-63cc-41e4-b0c8-5a21ee0853f0 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-a01d04ef-d627-4e6e-94dd-2ad1323c7f6a-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:40 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:40 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6
Apr 06 16:56:40 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:41 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6" returned: 0 in 0.434s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6" released by "delete_volume" :: held 0.982s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Created reservations ['ee3fd7df-af8b-4c44-bc38-977e67434ae1', '54204ebc-1243-4bdf-a7ed-0806a96a8c22', '76e97d8b-7112-435a-82e6-6302a0cdb4ff', '054ab552-26b5-4727-b062-a6023ce24a28'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:41 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:41 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:41 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:41 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Deleted volume successfully.
Apr 06 16:56:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-afec18da-0b45-4b5b-b2ea-8754e8d60c1e tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-042a11ce-bce1-4dcf-9eb1-4ee5f72a6ca6-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-1e2f4a14-c77c-4918-9dc8-7b24f085d932-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-1e2f4a14-c77c-4918-9dc8-7b24f085d932-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "cinder-quobyte-1e2f4a14-c77c-4918-9dc8-7b24f085d932" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-1e2f4a14-c77c-4918-9dc8-7b24f085d932" acquired by "delete_volume" :: waited 0.019s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:42 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c516b8a7-2fde-4748-8ca8-c54d055f3ed3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:42 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932
Apr 06 16:56:42 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:43 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932" returned: 0 in 0.505s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:43 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932
Apr 06 16:56:43 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:43 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1e2f4a14-c77c-4918-9dc8-7b24f085d932" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-quobyte-1e2f4a14-c77c-4918-9dc8-7b24f085d932" released by "delete_volume" :: held 0.977s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Created reservations ['9bd14956-4021-462d-a008-d9e4e82c6dc5', 'f1f8f8dc-4a8f-4813-a978-e15ce2b49553', '95c4e22e-c9f5-41e2-b829-e6e2e6266eec', '2867947d-a4fc-4a01-a3ff-8001b4e107ca'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:43 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:43 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:44 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:44 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:44 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Deleted volume successfully.
Apr 06 16:56:44 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b81d1c09-a002-445e-95bb-908982fa84c1 tempest-CreateVolumesFromImageTest-146628854 None] Lock "cinder-1e2f4a14-c77c-4918-9dc8-7b24f085d932-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Flow 'volume_create_manager' (ebdd302e-6bff-4908-8953-71b488173340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d34e34-f43c-49be-b948-2b98169cb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d34e34-f43c-49be-b948-2b98169cb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-576877968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8ae6f-0d0f-4812-bdad-6c487517be14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fc25a816f3469a8386f13cd8e17e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:51Z,use_quota=True,user_id='986836659ce2459483be61f0742aded4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ddc1764-53a2-4c26-a5b0-77220f7655c2),volume_type_id=5ddc1764-53a2-4c26-a5b0-77220f7655c2)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5f221f-53b5-46d9-9f7e-4b7cbaec0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5f221f-53b5-46d9-9f7e-4b7cbaec0a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef49f3e-6694-45b8-883b-9b000c5cc393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef49f3e-6694-45b8-883b-9b000c5cc393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e8ae6f-0d0f-4812-bdad-6c487517be14', 'volume_name': 'volume-10e8ae6f-0d0f-4812-bdad-6c487517be14', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0245ed77-1394-4922-b147-ec9f66304950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0245ed77-1394-4922-b147-ec9f66304950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e890b95-89dd-4b22-97d9-2e9308bdabd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:50 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Volume 10e8ae6f-0d0f-4812-bdad-6c487517be14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e8ae6f-0d0f-4812-bdad-6c487517be14', 'volume_size': 1}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-576877968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8ae6f-0d0f-4812-bdad-6c487517be14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fc25a816f3469a8386f13cd8e17e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:51Z,use_quota=True,user_id='986836659ce2459483be61f0742aded4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ddc1764-53a2-4c26-a5b0-77220f7655c2),volume_type_id=5ddc1764-53a2-4c26-a5b0-77220f7655c2)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Creating volume 10e8ae6f-0d0f-4812-bdad-6c487517be14 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:50 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:50 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 1073741824
Apr 06 16:56:50 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:51 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 1073741824" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:51 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14
Apr 06 16:56:51 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:51 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14" returned: 0 in 0.386s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e890b95-89dd-4b22-97d9-2e9308bdabd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e8ae6f-0d0f-4812-bdad-6c487517be14', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7acfd6-02eb-4f4b-aafb-3406de45a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:51 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Volume volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 (10e8ae6f-0d0f-4812-bdad-6c487517be14): created successfully
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7acfd6-02eb-4f4b-aafb-3406de45a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:51 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Flow 'volume_create_manager' (ebdd302e-6bff-4908-8953-71b488173340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:51 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b524e54b-b064-4d4b-9c78-c0129913028d tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Created volume successfully.
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:52 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:52 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:52 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:52 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:52 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c7bc575e-19f8-4778-91af-5abb2f0ed4a7 tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Retype volume completed successfully.
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Acquiring lock "cinder-10e8ae6f-0d0f-4812-bdad-6c487517be14-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "cinder-10e8ae6f-0d0f-4812-bdad-6c487517be14-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Acquiring lock "cinder-quobyte-10e8ae6f-0d0f-4812-bdad-6c487517be14" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "cinder-quobyte-10e8ae6f-0d0f-4812-bdad-6c487517be14" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[276b5c1a-462c-4f2f-9f2e-ab1661adcdac]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:53 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14
Apr 06 16:56:53 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:53 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:53 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14
Apr 06 16:56:53 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:54 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e8ae6f-0d0f-4812-bdad-6c487517be14" returned: 0 in 0.384s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "cinder-quobyte-10e8ae6f-0d0f-4812-bdad-6c487517be14" released by "delete_volume" :: held 0.847s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:54 devstack cinder-volume[82421]: WARNING cinder.quota [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:54 devstack cinder-volume[82421]: WARNING cinder.quota [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Created reservations ['d3a21273-9632-4df1-a3c2-684c2c2600d2', '83518772-3ada-4efb-8235-76071f0334ad', '15b3c4d3-0a42-4f9a-8d8b-6d400e4ca00b', '314ab1cc-3310-4fe1-99fc-36668ce089c0'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:54 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:54 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:54 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.406s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:54 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Deleted volume successfully.
Apr 06 16:56:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2aeb66a3-6f31-4622-9912-406d1088552f tempest-VolumeRetypeWithoutMigrationTest-618141642 None] Lock "cinder-10e8ae6f-0d0f-4812-bdad-6c487517be14-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Flow 'volume_create_manager' (cb18a8ac-61c6-485f-b3f3-ad3617ba3385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408daef0-dca5-47ac-b70a-a27b5cb195ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408daef0-dca5-47ac-b70a-a27b5cb195ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1268486288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed82c341-b318-455f-a252-edd92981704a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2cb518e2044ace869ee292785339f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:57Z,use_quota=True,user_id='ad2338fbb1c847f78acd582f63f01188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abae42de-32ee-49d6-bbb2-8915de8b05ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abae42de-32ee-49d6-bbb2-8915de8b05ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa90bbb0-3938-4b26-b632-7232e3a9e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa90bbb0-3938-4b26-b632-7232e3a9e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed82c341-b318-455f-a252-edd92981704a', 'volume_name': 'volume-ed82c341-b318-455f-a252-edd92981704a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80219d50-eda4-4aa1-b84e-d71a33c8f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80219d50-eda4-4aa1-b84e-d71a33c8f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c43a3d-f411-48cb-b8bd-87841ab178e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:57 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Volume ed82c341-b318-455f-a252-edd92981704a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed82c341-b318-455f-a252-edd92981704a', 'volume_size': 1}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1268486288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed82c341-b318-455f-a252-edd92981704a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2cb518e2044ace869ee292785339f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:56:57Z,use_quota=True,user_id='ad2338fbb1c847f78acd582f63f01188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Creating volume ed82c341-b318-455f-a252-edd92981704a {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:56:57 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:57 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a 1073741824
Apr 06 16:56:57 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:57 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a 1073741824" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:57 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a
Apr 06 16:56:57 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:58 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a" returned: 0 in 0.413s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c43a3d-f411-48cb-b8bd-87841ab178e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed82c341-b318-455f-a252-edd92981704a', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702a34c3-3200-4d55-b66e-8164f8d7dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:56:58 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Volume volume-ed82c341-b318-455f-a252-edd92981704a (ed82c341-b318-455f-a252-edd92981704a): created successfully
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702a34c3-3200-4d55-b66e-8164f8d7dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Flow 'volume_create_manager' (cb18a8ac-61c6-485f-b3f3-ad3617ba3385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:56:58 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-79e01919-8bc3-447a-8948-d033d46c082e tempest-VolumesServicesTestJSON-277860738 None] Created volume successfully.
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Acquiring lock "cinder-ed82c341-b318-455f-a252-edd92981704a-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Lock "cinder-ed82c341-b318-455f-a252-edd92981704a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Acquiring lock "cinder-quobyte-ed82c341-b318-455f-a252-edd92981704a" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Lock "cinder-quobyte-ed82c341-b318-455f-a252-edd92981704a" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c928a7-4174-4945-a77b-93b50daae2b3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:56:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:58 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a
Apr 06 16:56:58 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:59 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:59 devstack sudo[89570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a
Apr 06 16:56:59 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:59 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ed82c341-b318-455f-a252-edd92981704a" returned: 0 in 0.385s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Lock "cinder-quobyte-ed82c341-b318-455f-a252-edd92981704a" released by "delete_volume" :: held 0.868s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Created reservations ['b30c9daf-310d-4edf-9ec0-8e96fe10b83d', 'b9f935e5-3877-4a10-a7f5-d7f788aa7d87', '08d56333-2504-41da-9e8c-5bb81c70988f', 'f9062b7c-50c0-4ce6-94c4-d28af57f1f1b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:56:59 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:56:59 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:56:59 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:56:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Deleted volume successfully.
Apr 06 16:56:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-58d17d40-aff5-43a5-843a-7a9ee0cab22c tempest-VolumesServicesTestJSON-277860738 None] Lock "cinder-ed82c341-b318-455f-a252-edd92981704a-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Flow 'volume_create_manager' (e9d03776-dbb2-4fd2-b375-cab26ba9d055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96889cf7-1ff2-4ddd-95a8-32292f74ece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96889cf7-1ff2-4ddd-95a8-32292f74ece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2034252419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e90922-d4d6-44de-86e2-054ae4f591e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5204fa27ef3f4ec1a0818767cc0a3f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:03Z,use_quota=True,user_id='1b0612fd64b345c3893a6caeb8ddf590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f19a414-fd73-4c9a-9800-8db039a71981),volume_type_id=2f19a414-fd73-4c9a-9800-8db039a71981)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e975d1-c28f-49e4-becc-1be90d0106c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e975d1-c28f-49e4-becc-1be90d0106c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59245590-0440-48be-a360-fad444e21ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59245590-0440-48be-a360-fad444e21ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e90922-d4d6-44de-86e2-054ae4f591e2', 'volume_name': 'volume-47e90922-d4d6-44de-86e2-054ae4f591e2', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c29435-ff5f-4fc4-98bc-7a099a493c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c29435-ff5f-4fc4-98bc-7a099a493c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ebbf56-f910-45ea-bc99-a6411a840ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Volume 47e90922-d4d6-44de-86e2-054ae4f591e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e90922-d4d6-44de-86e2-054ae4f591e2', 'volume_size': 1}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2034252419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e90922-d4d6-44de-86e2-054ae4f591e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5204fa27ef3f4ec1a0818767cc0a3f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:03Z,use_quota=True,user_id='1b0612fd64b345c3893a6caeb8ddf590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f19a414-fd73-4c9a-9800-8db039a71981),volume_type_id=2f19a414-fd73-4c9a-9800-8db039a71981)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Creating volume 47e90922-d4d6-44de-86e2-054ae4f591e2 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:02 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:02 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2 1073741824
Apr 06 16:57:02 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:03 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2 1073741824" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:03 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2
Apr 06 16:57:03 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:03 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:03 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:03 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ebbf56-f910-45ea-bc99-a6411a840ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e90922-d4d6-44de-86e2-054ae4f591e2', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208960e6-ab59-45e8-9875-111d3c01dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:03 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Volume volume-47e90922-d4d6-44de-86e2-054ae4f591e2 (47e90922-d4d6-44de-86e2-054ae4f591e2): created successfully
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208960e6-ab59-45e8-9875-111d3c01dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Flow 'volume_create_manager' (e9d03776-dbb2-4fd2-b375-cab26ba9d055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-54a487ad-1764-44f9-8a84-97b26807740f tempest-VolumeTypesAccessTest-1243780382 None] Created volume successfully.
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Acquiring lock "cinder-47e90922-d4d6-44de-86e2-054ae4f591e2-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Lock "cinder-47e90922-d4d6-44de-86e2-054ae4f591e2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Acquiring lock "cinder-quobyte-47e90922-d4d6-44de-86e2-054ae4f591e2" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Lock "cinder-quobyte-47e90922-d4d6-44de-86e2-054ae4f591e2" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b31e12-cda2-4412-87af-4ad5ce3e695a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:04 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2
Apr 06 16:57:04 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:04 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:04 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:04 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2
Apr 06 16:57:04 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:04 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47e90922-d4d6-44de-86e2-054ae4f591e2" returned: 0 in 0.392s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Lock "cinder-quobyte-47e90922-d4d6-44de-86e2-054ae4f591e2" released by "delete_volume" :: held 0.881s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:04 devstack cinder-volume[82421]: WARNING cinder.quota [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1806185743 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1806185743, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:57:04 devstack cinder-volume[82421]: WARNING cinder.quota [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1806185743 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1806185743, it is now deprecated. Please use the default quota class for default quota.
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Created reservations ['96a85b8c-5f7b-43d7-8515-ec45f059970c', '1930c83d-b0f2-4c22-b030-46996fa2ac67', 'e170d3a2-bb8b-4b3a-ac7e-ac6a84cd7510', '38f3277e-b6d5-4244-9e2f-e87f6faf2121'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:04 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:04 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:05 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:05 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:05 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Deleted volume successfully.
Apr 06 16:57:05 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-56ce0471-218d-48a6-8fdc-14eb391364a2 tempest-VolumeTypesAccessTest-1243780382 None] Lock "cinder-47e90922-d4d6-44de-86e2-054ae4f591e2-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Flow 'volume_create_manager' (7c501d27-1373-4f4c-9dde-80ce01d4729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd01591-8bb4-4054-ac22-a63f37b65867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd01591-8bb4-4054-ac22-a63f37b65867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-974277906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f29a44c-de45-4f1d-9320-629de5c1a9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e68f1775c2c4f0d93f336da9fe3753e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:13Z,use_quota=True,user_id='92a19a7f985d49258eaaa39734b36f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a9b232-919f-4d70-8338-1af6035d0b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a9b232-919f-4d70-8338-1af6035d0b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86479bb6-3280-4957-a9a8-63c43250a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:12 devstack cinder-volume[82421]: DEBUG cinder.image.glance [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Creating Keystone auth plugin from conf {{(pid=82421) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86479bb6-3280-4957-a9a8-63c43250a6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f29a44c-de45-4f1d-9320-629de5c1a9ba', 'volume_name': 'volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e155be9b0>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f31877-5c68-4ba2-ad76-7f38a8101cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f31877-5c68-4ba2-ad76-7f38a8101cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2c1991-e5fb-4a19-b34a-727f192dfe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Volume 1f29a44c-de45-4f1d-9320-629de5c1a9ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e155be9b0>}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Trying to clone 1f29a44c-de45-4f1d-9320-629de5c1a9ba from image 765549bd-5564-4279-accf-2c50ecfd6b86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]). {{(pid=82421) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 06 16:57:13 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Image download 20.69 MB at 20.69 MB/s
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[349731f8-bdc5-4c75-8d78-3c3a8ec94672]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:13 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD
Apr 06 16:57:13 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:13 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 is fetched for user 92a19a7f985d49258eaaa39734b36f2a. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2093f08-afaf-4ddf-9e77-1c9a0c83d5f7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:13 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD
Apr 06 16:57:13 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:14 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-974277906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f29a44c-de45-4f1d-9320-629de5c1a9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e68f1775c2c4f0d93f336da9fe3753e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:13Z,use_quota=True,user_id='92a19a7f985d49258eaaa39734b36f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Creating volume 1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:14 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:14 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba 1073741824
Apr 06 16:57:14 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:14 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba 1073741824" returned: 0 in 0.447s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:14 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:14 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:15 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 0 in 0.377s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Attempting download of 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume 1f29a44c-de45-4f1d-9320-629de5c1a9ba. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c01fbf-81a7-4d53-a63d-dcafc506d233]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:15 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo
Apr 06 16:57:15 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:15 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo" returned: 0 in 0.426s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:15 devstack sudo[89629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo
Apr 06 16:57:15 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:16 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo" returned: 1 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_pyex29qo' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c0061e-12b0-4c43-99b5-d045d87c605a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:16 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD
Apr 06 16:57:16 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:16 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] 765549bd-5564-4279-accf-2c50ecfd6b86 was qcow2, converting to raw {{(pid=82421) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 06 16:57:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:16 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:16 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:17 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 0 in 0.801s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:17 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_izgvahrwdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:57:17 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Converted 112.00 MB image at 112.00 MB/s
Apr 06 16:57:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:17 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba 1G
Apr 06 16:57:17 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:17 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba 1G" returned: 0 in 0.411s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:17 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba08ff1-4d89-430c-bf8b-312477b2e156]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:17 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:17 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:18 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:18 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:18 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:18 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 1 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Downloaded image 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume 1f29a44c-de45-4f1d-9320-629de5c1a9ba successfully. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 for user 92a19a7f985d49258eaaa39734b36f2a is deleted. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Marking volume 1f29a44c-de45-4f1d-9320-629de5c1a9ba as bootable. {{(pid=82421) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Copying metadata from image 765549bd-5564-4279-accf-2c50ecfd6b86 to 1f29a44c-de45-4f1d-9320-629de5c1a9ba. {{(pid=82421) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Creating volume glance metadata for volume 1f29a44c-de45-4f1d-9320-629de5c1a9ba backed by image 765549bd-5564-4279-accf-2c50ecfd6b86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82421) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2c1991-e5fb-4a19-b34a-727f192dfe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e155be9b0>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043c6a58-67af-4025-9694-9b14f779d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:18 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Volume volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba (1f29a44c-de45-4f1d-9320-629de5c1a9ba): created successfully
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043c6a58-67af-4025-9694-9b14f779d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:18 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Flow 'volume_create_manager' (7c501d27-1373-4f4c-9dde-80ce01d4729e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:18 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-917d5317-aa81-44c9-b22e-637b182b0126 tempest-VolumesImageMetadata-1828115463 None] Created volume successfully.
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Acquiring lock "cinder-1f29a44c-de45-4f1d-9320-629de5c1a9ba-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Lock "cinder-1f29a44c-de45-4f1d-9320-629de5c1a9ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Acquiring lock "cinder-quobyte-1f29a44c-de45-4f1d-9320-629de5c1a9ba" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Lock "cinder-quobyte-1f29a44c-de45-4f1d-9320-629de5c1a9ba" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ecc2f-d57e-4283-842c-f16b583c9f04]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:19 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:19 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:19 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:20 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:20 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:20 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 1 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:20 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba
Apr 06 16:57:20 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:20 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1f29a44c-de45-4f1d-9320-629de5c1a9ba" returned: 0 in 0.389s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Lock "cinder-quobyte-1f29a44c-de45-4f1d-9320-629de5c1a9ba" released by "delete_volume" :: held 1.338s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Created reservations ['9c1aa1a9-69b3-4ee5-bf68-80a88fe1ca7e', '47755d56-6c3f-448c-b0e4-521e543722cf', 'edaed600-e19e-4650-94f8-a3a541f4b40e', 'c7a43b3b-2c08-4320-a1bf-ed2d26e4fa65'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:20 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:20 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:21 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.386s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:21 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Deleted volume successfully.
Apr 06 16:57:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6f78acc3-0ba7-48ba-867b-2650b10bc39d tempest-VolumesImageMetadata-1828115463 None] Lock "cinder-1f29a44c-de45-4f1d-9320-629de5c1a9ba-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=172,cinder:INSERT=64,cinder:UPDATE=221,cinder:DELETE=11 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=162,cinder:UPDATE=228,cinder:INSERT=54,cinder:DELETE=20 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Flow 'volume_create_manager' (5a4f3eff-0933-4939-a1b5-43493819636a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e85207-e933-48bb-a77f-69ff44e35eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e85207-e933-48bb-a77f-69ff44e35eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-916264947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cd1526-c9a2-49a0-8069-31ec15211460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505690c7780f433db58f710ec261230c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:24Z,use_quota=True,user_id='0f13a77dff5445beaa9c12d588bd1cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b491948f-0569-40b6-96f7-8d90b9b08d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b491948f-0569-40b6-96f7-8d90b9b08d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283940d0-e6ed-4b06-ae48-31d667311c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283940d0-e6ed-4b06-ae48-31d667311c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cd1526-c9a2-49a0-8069-31ec15211460', 'volume_name': 'volume-76cd1526-c9a2-49a0-8069-31ec15211460', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02949fcd-2ff0-468b-8cbd-37b0ef0cc392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02949fcd-2ff0-468b-8cbd-37b0ef0cc392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5054c4c3-d041-47b1-a495-1b1bc888070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:23 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Volume 76cd1526-c9a2-49a0-8069-31ec15211460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cd1526-c9a2-49a0-8069-31ec15211460', 'volume_size': 1}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-916264947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cd1526-c9a2-49a0-8069-31ec15211460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505690c7780f433db58f710ec261230c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:24Z,use_quota=True,user_id='0f13a77dff5445beaa9c12d588bd1cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Creating volume 76cd1526-c9a2-49a0-8069-31ec15211460 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:23 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:23 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460 1073741824
Apr 06 16:57:23 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:24 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460 1073741824" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:24 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460
Apr 06 16:57:24 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:24 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460" returned: 0 in 0.384s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5054c4c3-d041-47b1-a495-1b1bc888070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cd1526-c9a2-49a0-8069-31ec15211460', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ba90c1-30ef-4d6e-859a-391ead418d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:24 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Volume volume-76cd1526-c9a2-49a0-8069-31ec15211460 (76cd1526-c9a2-49a0-8069-31ec15211460): created successfully
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ba90c1-30ef-4d6e-859a-391ead418d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Flow 'volume_create_manager' (5a4f3eff-0933-4939-a1b5-43493819636a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0059decc-4c10-43cd-893d-9e3c33d87bd2 tempest-AbsoluteLimitsTests-1145605368 None] Created volume successfully.
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Acquiring lock "cinder-76cd1526-c9a2-49a0-8069-31ec15211460-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Lock "cinder-76cd1526-c9a2-49a0-8069-31ec15211460-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Acquiring lock "cinder-quobyte-76cd1526-c9a2-49a0-8069-31ec15211460" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Lock "cinder-quobyte-76cd1526-c9a2-49a0-8069-31ec15211460" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[070aaf4e-b960-481c-a130-2f418b17b806]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:24 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460
Apr 06 16:57:24 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:25 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460" returned: 0 in 0.452s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:25 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460
Apr 06 16:57:25 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:25 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-76cd1526-c9a2-49a0-8069-31ec15211460" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Lock "cinder-quobyte-76cd1526-c9a2-49a0-8069-31ec15211460" released by "delete_volume" :: held 0.869s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Created reservations ['e8b764f2-467a-4dbf-83b4-a98edef95be5', 'a75052ff-2759-4aeb-b2af-0f820f5f1dfa', 'ce10833a-bcc4-49cc-9e76-56230bde5cf1', '66a231b0-1ab2-492a-a21c-bc23a91cbee4'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:25 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:25 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:26 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.428s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:26 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Deleted volume successfully.
Apr 06 16:57:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2709d07e-4b40-4c1f-b564-a6067c63eb22 tempest-AbsoluteLimitsTests-1145605368 None] Lock "cinder-76cd1526-c9a2-49a0-8069-31ec15211460-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (3bb91242-773c-4737-8054-af43ae28b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139fdee7-7459-4a6a-8e94-94bacd978ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139fdee7-7459-4a6a-8e94-94bacd978ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1656137130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fecd03d-8697-4053-b5a7-840e0c10d7ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:28Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc3ae23-1885-4b94-a3c9-7574685ff81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc3ae23-1885-4b94-a3c9-7574685ff81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbc3eaf-b5ec-4135-9cdf-195807fa52ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbc3eaf-b5ec-4135-9cdf-195807fa52ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fecd03d-8697-4053-b5a7-840e0c10d7ec', 'volume_name': 'volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3721445f-1d0d-468c-83d4-9a0b0f89e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3721445f-1d0d-468c-83d4-9a0b0f89e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2222a197-4b65-4f13-802d-c9f86dda0d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:28 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Volume 2fecd03d-8697-4053-b5a7-840e0c10d7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec', 'volume_size': 1}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1656137130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fecd03d-8697-4053-b5a7-840e0c10d7ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:28Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Creating volume 2fecd03d-8697-4053-b5a7-840e0c10d7ec {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:28 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:28 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec 1073741824
Apr 06 16:57:28 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:28 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec 1073741824" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:28 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec
Apr 06 16:57:28 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:29 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec" returned: 0 in 0.402s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2222a197-4b65-4f13-802d-c9f86dda0d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2805d65-5455-4670-b408-66de31015fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:29 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Volume volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec (2fecd03d-8697-4053-b5a7-840e0c10d7ec): created successfully
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2805d65-5455-4670-b408-66de31015fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (3bb91242-773c-4737-8054-af43ae28b721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:29 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-06eb08c1-10df-422a-926f-a71180275410 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (d44eaa1c-a0f9-43ea-a024-81012402ecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1bd204-1850-486d-a48c-3499fa0a69e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1bd204-1850-486d-a48c-3499fa0a69e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-55852391',display_name='tempest-VolumesGetTest-Volume-1541879172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfcdbdc-177d-4b72-b4ce-e581b8c356a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:30Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b62b9f-5b1d-47cb-a95d-52639234e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b62b9f-5b1d-47cb-a95d-52639234e995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4541a1b0-de62-43cb-be6c-13e9928a7d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4541a1b0-de62-43cb-be6c-13e9928a7d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdfcdbdc-177d-4b72-b4ce-e581b8c356a0', 'volume_name': 'volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c6f332-1328-4342-85c1-0f59310c0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c6f332-1328-4342-85c1-0f59310c0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f7fb73-f4f7-46a0-8e80-e5d9882e2235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:29 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Volume bdfcdbdc-177d-4b72-b4ce-e581b8c356a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0', 'volume_size': 1}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-55852391',display_name='tempest-VolumesGetTest-Volume-1541879172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfcdbdc-177d-4b72-b4ce-e581b8c356a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:30Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Creating volume bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:29 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:29 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 1073741824
Apr 06 16:57:29 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:30 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 1073741824" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:30 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0
Apr 06 16:57:30 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:30 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f7fb73-f4f7-46a0-8e80-e5d9882e2235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d6675-4c0f-478c-a9a9-b3a0995147e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:30 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Volume volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 (bdfcdbdc-177d-4b72-b4ce-e581b8c356a0): created successfully
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d6675-4c0f-478c-a9a9-b3a0995147e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (d44eaa1c-a0f9-43ea-a024-81012402ecbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d2359e0f-e161-4981-82a1-143c704bb110 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Lock "cinder-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b1a34b-4b64-4e79-82b7-8a3e5495b979]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:30 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0
Apr 06 16:57:30 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:31 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0" returned: 0 in 0.443s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:31 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0
Apr 06 16:57:31 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:31 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0" released by "delete_volume" :: held 0.861s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Created reservations ['c3e87ea9-7186-4bec-bd0a-440b51b80b44', '2bbd843f-05c2-404f-8a54-4ef21323fd94', 'daa792c6-9342-4d86-b18e-fca5e01197ea', '4e478e24-0d51-4c59-a01a-a4da6fecdaeb'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:31 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:31 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-2fecd03d-8697-4053-b5a7-840e0c10d7ec-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Lock "cinder-2fecd03d-8697-4053-b5a7-840e0c10d7ec-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-2fecd03d-8697-4053-b5a7-840e0c10d7ec" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-2fecd03d-8697-4053-b5a7-840e0c10d7ec" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d344003a-41da-4d73-96b0-ca7ccd33ab16]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:32 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec
Apr 06 16:57:32 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:32 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.415s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:32 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4a1cdc0b-03f8-401f-872c-67f9ac157e12 tempest-VolumesGetTest-1236250106 None] Lock "cinder-bdfcdbdc-177d-4b72-b4ce-e581b8c356a0-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:32 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec" returned: 0 in 0.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:32 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec
Apr 06 16:57:32 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:32 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2fecd03d-8697-4053-b5a7-840e0c10d7ec" returned: 0 in 0.393s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-2fecd03d-8697-4053-b5a7-840e0c10d7ec" released by "delete_volume" :: held 0.896s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Created reservations ['7708f6da-16aa-4924-b387-b9a2ec20de0c', '10aead8b-de8c-423e-bbf9-069ecaa6b321', 'dc08e331-40db-40c9-afef-093ab835464f', '1c3ad70b-9301-4395-a58d-921886098f68'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:32 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:32 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (d636f9ec-d33b-40c4-a515-c090814a14f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13748855-13e9-44c8-8c22-f54607afa9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13748855-13e9-44c8-8c22-f54607afa9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1335483735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a48450-28ec-464b-9409-b592f5cd040e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:33Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e954afc0-f279-47d8-b557-0617120933a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e954afc0-f279-47d8-b557-0617120933a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdeeab6-ee2c-40f9-a4fc-3a140977cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbdeeab6-ee2c-40f9-a4fc-3a140977cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a48450-28ec-464b-9409-b592f5cd040e', 'volume_name': 'volume-47a48450-28ec-464b-9409-b592f5cd040e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a073e5-6deb-4958-8061-f8f87e1e8315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a073e5-6deb-4958-8061-f8f87e1e8315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d12e827-d9bd-4c6e-a0b2-7ff99c26c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Volume 47a48450-28ec-464b-9409-b592f5cd040e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a48450-28ec-464b-9409-b592f5cd040e', 'volume_size': 1}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1335483735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a48450-28ec-464b-9409-b592f5cd040e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:33Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Creating volume 47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:33 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:33 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e 1073741824
Apr 06 16:57:33 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:33 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.454s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8cd115cb-707e-4921-9ecc-5b208b6ac2ca tempest-VolumesGetTest-1236250106 None] Lock "cinder-2fecd03d-8697-4053-b5a7-840e0c10d7ec-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:33 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e 1073741824" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:33 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:33 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:34 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d12e827-d9bd-4c6e-a0b2-7ff99c26c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a48450-28ec-464b-9409-b592f5cd040e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d246ccc-2068-432f-9efe-8285a7b6659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Volume volume-47a48450-28ec-464b-9409-b592f5cd040e (47a48450-28ec-464b-9409-b592f5cd040e): created successfully
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d246ccc-2068-432f-9efe-8285a7b6659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (d636f9ec-d33b-40c4-a515-c090814a14f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5d195083-9010-4ae1-bee0-adaefd305476 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (7fa9cc65-b6c3-4d60-9d3d-d5211651aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7c299-7798-43df-92f4-4b8902f7faa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa7c299-7798-43df-92f4-4b8902f7faa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1398502800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff260f2-560e-464f-8040-10cf1f8e1b8d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=47a48450-28ec-464b-9409-b592f5cd040e,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:34Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f874d4e4-bd43-43f5-bc47-2619648442af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f874d4e4-bd43-43f5-bc47-2619648442af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cec909-12ca-4796-adc0-5289e91a13c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cec909-12ca-4796-adc0-5289e91a13c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bff260f2-560e-464f-8040-10cf1f8e1b8d', 'volume_name': 'volume-bff260f2-560e-464f-8040-10cf1f8e1b8d', 'volume_size': 1, 'source_volid': '47a48450-28ec-464b-9409-b592f5cd040e', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdf16c8-9c3a-4105-b51d-38a084c814ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdf16c8-9c3a-4105-b51d-38a084c814ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607aea8c-d7db-4177-aecb-552fb9936872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Volume bff260f2-560e-464f-8040-10cf1f8e1b8d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bff260f2-560e-464f-8040-10cf1f8e1b8d', 'volume_size': 1, 'source_volid': '47a48450-28ec-464b-9409-b592f5cd040e', 'source_volstatus': 'available'}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:34 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Cloning volume 47a48450-28ec-464b-9409-b592f5cd040e to volume bff260f2-560e-464f-8040-10cf1f8e1b8d
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Creating offline snapshot d950cc45-638e-49f7-b732-185937ac42cf of volume 47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14da43b-373e-45f7-a6ab-2c0fe248d00b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:34 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:34 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:35 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:35 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf 1G
Apr 06 16:57:35 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:35 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf 1G" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a48450-28ec-464b-9409-b592f5cd040e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:35 devstack sudo[89792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a48450-28ec-464b-9409-b592f5cd040e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf
Apr 06 16:57:35 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:35 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47a48450-28ec-464b-9409-b592f5cd040e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf" returned: 0 in 0.412s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:35 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf is being set with open permissions: ugo+rw
Apr 06 16:57:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:35 devstack sudo[89797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf
Apr 06 16:57:35 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:36 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf" returned: 0 in 0.389s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:36 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info
Apr 06 16:57:36 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:36 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info" returned: 0 in 0.418s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:36 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info is being set with open permissions: ugo+rw
Apr 06 16:57:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:36 devstack sudo[89803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info
Apr 06 16:57:36 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:37 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.info" returned: 0 in 0.391s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-bff260f2-560e-464f-8040-10cf1f8e1b8d" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-bff260f2-560e-464f-8040-10cf1f8e1b8d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] snapshot: d950cc45-638e-49f7-b732-185937ac42cf, volume: bff260f2-560e-464f-8040-10cf1f8e1b8d,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d512cd1-0c93-4b2d-9aae-74dd0c09955e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:37 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf
Apr 06 16:57:37 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:37 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf" returned: 0 in 0.458s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a48450-28ec-464b-9409-b592f5cd040e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01e8e23-b8e1-4eca-bc06-0814f0d37ad6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:37 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:37 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:38 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.454s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:38 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:57:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:38 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d
Apr 06 16:57:38 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:40 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d" returned: 0 in 1.966s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:40 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c958b1ec-c2f5-4e9a-8983-aacff8afbe8a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:40 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:40 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:40 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.584s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:40 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:57:40 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Converted 1024.00 MB image at 520.51 MB/s
Apr 06 16:57:40 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d is being set with open permissions: ugo+rw
Apr 06 16:57:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:40 devstack sudo[89833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d
Apr 06 16:57:40 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:41 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d" returned: 0 in 0.388s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-bff260f2-560e-464f-8040-10cf1f8e1b8d" released by "_copy_volume_from_snapshot" :: held 3.894s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-d950cc45-638e-49f7-b732-185937ac42cf" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-d950cc45-638e-49f7-b732-185937ac42cf" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Deleting offline snapshot d950cc45-638e-49f7-b732-185937ac42cf of volume 47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] snapshot_file for this snap is: volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534a4e9-c90e-4222-afb6-85ba7ea100d9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:41 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf
Apr 06 16:57:41 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:41 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf" returned: 0 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47a48450-28ec-464b-9409-b592f5cd040e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc1a99a-433a-426e-82e7-6e43f645469e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:41 devstack sudo[89841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:41 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:42 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:42 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf
Apr 06 16:57:42 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:42 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:42 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf
Apr 06 16:57:42 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:42 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e.d950cc45-638e-49f7-b732-185937ac42cf" returned: 0 in 0.392s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-d950cc45-638e-49f7-b732-185937ac42cf" released by "_delete_snapshot" :: held 1.792s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.308s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607aea8c-d7db-4177-aecb-552fb9936872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff260f2-560e-464f-8040-10cf1f8e1b8d', 'volume_size': 1, 'source_volid': '47a48450-28ec-464b-9409-b592f5cd040e', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3408c2c3-49cb-4a57-a601-92c1b4a5d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:42 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Volume volume-bff260f2-560e-464f-8040-10cf1f8e1b8d (bff260f2-560e-464f-8040-10cf1f8e1b8d): created successfully
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3408c2c3-49cb-4a57-a601-92c1b4a5d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:42 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (7fa9cc65-b6c3-4d60-9d3d-d5211651aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:42 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e0ca4bdf-ff17-4125-beec-1e58c2ec5172 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (86afbf32-708b-4b98-8d97-ef008b9238cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afde55e-ce4e-4120-97c2-f6d05f8bd677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afde55e-ce4e-4120-97c2-f6d05f8bd677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-324583920',display_name='tempest-VolumesGetTest-Volume-792225399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e0a958-bd30-4693-8287-c971fdf5fa13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:44Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7490211-03a5-4d60-91fb-6c11a14417dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7490211-03a5-4d60-91fb-6c11a14417dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ca166a-ed3b-4732-802f-0883152b5f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ca166a-ed3b-4732-802f-0883152b5f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e0a958-bd30-4693-8287-c971fdf5fa13', 'volume_name': 'volume-e6e0a958-bd30-4693-8287-c971fdf5fa13', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82710415-679d-4741-8468-ba8c305d21a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82710415-679d-4741-8468-ba8c305d21a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ebdad1-9d3b-40bd-a612-52f93574c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:44 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Volume e6e0a958-bd30-4693-8287-c971fdf5fa13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e0a958-bd30-4693-8287-c971fdf5fa13', 'volume_size': 1}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-324583920',display_name='tempest-VolumesGetTest-Volume-792225399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e0a958-bd30-4693-8287-c971fdf5fa13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:44Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Creating volume e6e0a958-bd30-4693-8287-c971fdf5fa13 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:44 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:44 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 1073741824
Apr 06 16:57:44 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:44 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 1073741824" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:44 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13
Apr 06 16:57:44 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:45 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13" returned: 0 in 0.391s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ebdad1-9d3b-40bd-a612-52f93574c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e0a958-bd30-4693-8287-c971fdf5fa13', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117f71b9-6af7-4d39-b42b-b050022b8eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:45 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Volume volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 (e6e0a958-bd30-4693-8287-c971fdf5fa13): created successfully
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117f71b9-6af7-4d39-b42b-b050022b8eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (86afbf32-708b-4b98-8d97-ef008b9238cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:45 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6021908f-a732-419e-b57c-9d4774206028 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-e6e0a958-bd30-4693-8287-c971fdf5fa13-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Lock "cinder-e6e0a958-bd30-4693-8287-c971fdf5fa13-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-e6e0a958-bd30-4693-8287-c971fdf5fa13" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-e6e0a958-bd30-4693-8287-c971fdf5fa13" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[508acf1f-a863-43a0-8fe2-86d92add63ab]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:45 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13
Apr 06 16:57:45 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:46 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13" returned: 0 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:46 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13
Apr 06 16:57:46 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:46 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e6e0a958-bd30-4693-8287-c971fdf5fa13" returned: 0 in 0.384s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-e6e0a958-bd30-4693-8287-c971fdf5fa13" released by "delete_volume" :: held 0.846s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Created reservations ['0aaefbd8-662a-4535-a157-9a853476d240', 'e6d04cd1-074e-4686-b602-fc75d2b28976', 'd1d38c8d-c931-45ba-a3c6-a0eaf8989ba9', '5e877903-580e-46b2-8ac3-d3e5caf24b8f'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:46 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:46 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-bff260f2-560e-464f-8040-10cf1f8e1b8d-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Lock "cinder-bff260f2-560e-464f-8040-10cf1f8e1b8d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-bff260f2-560e-464f-8040-10cf1f8e1b8d" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-bff260f2-560e-464f-8040-10cf1f8e1b8d" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d738ca-2596-479b-9ae4-1044718af1dd]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:46 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d
Apr 06 16:57:46 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:47 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.418s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac284ce7-19b6-43df-b02f-c9b86092f1f0 tempest-VolumesGetTest-1236250106 None] Lock "cinder-e6e0a958-bd30-4693-8287-c971fdf5fa13-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:47 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:47 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d
Apr 06 16:57:47 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:47 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-bff260f2-560e-464f-8040-10cf1f8e1b8d" returned: 0 in 0.391s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-bff260f2-560e-464f-8040-10cf1f8e1b8d" released by "delete_volume" :: held 0.871s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Created reservations ['69c040b5-9d4a-433f-8c81-0eb042bdfd0e', 'd6fa57de-3912-4cb9-8c22-0f254e9bb70b', 'a45f1f4f-c9be-4c8b-a80c-19343dc7efc2', '0ecadaac-3572-4e5f-bf30-32ce3530cc82'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:47 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:47 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-47a48450-28ec-464b-9409-b592f5cd040e-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Lock "cinder-47a48450-28ec-464b-9409-b592f5cd040e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-47a48450-28ec-464b-9409-b592f5cd040e" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-47a48450-28ec-464b-9409-b592f5cd040e" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c184df-f6fe-4f64-9e73-72206dd64ad6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:48 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:48 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:48 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:48 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f6333b35-db0b-4650-81be-2564af4669f5 tempest-VolumesGetTest-1236250106 None] Lock "cinder-bff260f2-560e-464f-8040-10cf1f8e1b8d-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:48 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.463s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:48 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e
Apr 06 16:57:48 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:48 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-47a48450-28ec-464b-9409-b592f5cd040e" returned: 0 in 0.388s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-47a48450-28ec-464b-9409-b592f5cd040e" released by "delete_volume" :: held 0.878s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Created reservations ['c1347f23-e0bc-4532-aa77-44038aa6cc55', 'cf4497fa-9392-49d7-b610-14d59495df25', '18c05b80-936a-4fe3-9ace-1a8fa6ae4c15', '215df651-aa0f-48ca-b631-27fcbf9b24d6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:48 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:48 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:49 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.445s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:49 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c4e7489-22ea-4c54-bc7a-856516b6ee41 tempest-VolumesGetTest-1236250106 None] Lock "cinder-47a48450-28ec-464b-9409-b592f5cd040e-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (c22fa0c6-8116-41a9-a436-85f65b44c245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73edd9b-6bca-417b-9407-a3144ead3029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73edd9b-6bca-417b-9407-a3144ead3029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1467731593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:49Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3868097b-9df8-47bb-aadf-833465f75fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3868097b-9df8-47bb-aadf-833465f75fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdd6a40-0773-4261-8428-8b4c9c0b6d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.image.glance [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Creating Keystone auth plugin from conf {{(pid=82421) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdd6a40-0773-4261-8428-8b4c9c0b6d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154', 'volume_name': 'volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e153dd3f0>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1478258-3d44-4753-bf7a-015b6f35e92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1478258-3d44-4753-bf7a-015b6f35e92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7467f9cc-4f88-4d4a-930d-140cac0ee246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:49 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Volume c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e153dd3f0>}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Trying to clone c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 from image 765549bd-5564-4279-accf-2c50ecfd6b86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]). {{(pid=82421) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 06 16:57:49 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Image download 20.69 MB at 20.69 MB/s
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66f2a3-b477-401c-91ad-4575d6df1488]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:49 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD
Apr 06 16:57:49 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:50 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 is fetched for user 0670ba5c89564ff4ad5caa50c2cbcff7. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b745daf-7319-4466-9d7f-6e5465610a95]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:50 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD
Apr 06 16:57:50 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:50 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1467731593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:49Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Creating volume c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:50 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:50 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 1073741824
Apr 06 16:57:50 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:51 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 1073741824" returned: 0 in 0.448s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:51 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:51 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:51 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 0 in 0.402s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Attempting download of 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf6b65-0631-4438-8d29-b256fb9ff06f]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:51 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6
Apr 06 16:57:51 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:52 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:52 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6
Apr 06 16:57:52 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:52 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6" returned: 1 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_765549bd-5564-4279-accf-2c50ecfd6b86_x0fn70j6' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:57:52 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa035598-cd32-4fb1-b3d4-78f2f6276490]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:52 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD
Apr 06 16:57:52 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:53 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:53 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] 765549bd-5564-4279-accf-2c50ecfd6b86 was qcow2, converting to raw {{(pid=82421) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 06 16:57:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:53 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:53 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:53 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 0 in 0.799s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:53 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_765549bd-5564-4279-accf-2c50ecfd6b86_ukex7_1fdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:57:53 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Converted 112.00 MB image at 112.00 MB/s
Apr 06 16:57:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:53 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 1G
Apr 06 16:57:53 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:54 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 1G" returned: 0 in 0.404s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:54 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c0474-5f3b-46d0-8174-6deeb13b9819]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:54 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:54 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:54 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:54 devstack sudo[89955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:54 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:55 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 1 in 0.441s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Downloaded image 765549bd-5564-4279-accf-2c50ecfd6b86 ((None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}])) to volume c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 successfully. {{(pid=82421) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Temporary image 765549bd-5564-4279-accf-2c50ecfd6b86 for user 0670ba5c89564ff4ad5caa50c2cbcff7 is deleted. {{(pid=82421) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.volume_utils [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Marking volume c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 as bootable. {{(pid=82421) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Copying metadata from image 765549bd-5564-4279-accf-2c50ecfd6b86 to c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154. {{(pid=82421) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Creating volume glance metadata for volume c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 backed by image 765549bd-5564-4279-accf-2c50ecfd6b86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82421) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7467f9cc-4f88-4d4a-930d-140cac0ee246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154', 'volume_size': 1, 'image_id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/765549bd-5564-4279-accf-2c50ecfd6b86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1330b016aeb7419d88a86c16eacdd18d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '765549bd-5564-4279-accf-2c50ecfd6b86', 'created_at': datetime.datetime(2026, 4, 6, 14, 45, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 6, 14, 45, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/765549bd-5564-4279-accf-2c50ecfd6b86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6e153dd3f0>}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe70197-234c-4464-bd45-c2d8000adc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:55 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Volume volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 (c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154): created successfully
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe70197-234c-4464-bd45-c2d8000adc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:55 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (c22fa0c6-8116-41a9-a436-85f65b44c245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:55 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-34a81774-c900-4538-a8e5-9e0233c4a3d4 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (ffbd6862-0531-4b85-af9d-6cafb122d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae21191-11c7-4b7f-b65d-bf75d631f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae21191-11c7-4b7f-b65d-bf75d631f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1653029721',display_name='tempest-VolumesGetTest-Volume-1493425389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664557af-6fba-49d8-bc97-e4d0a437841f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:56Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a96634-56d6-476a-a48b-8b956000fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a96634-56d6-476a-a48b-8b956000fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5e5f75-7c80-4fe2-af58-f81da891206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5e5f75-7c80-4fe2-af58-f81da891206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664557af-6fba-49d8-bc97-e4d0a437841f', 'volume_name': 'volume-664557af-6fba-49d8-bc97-e4d0a437841f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d858d8fe-a037-4ff9-85f1-f8baab14e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d858d8fe-a037-4ff9-85f1-f8baab14e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773ecc2e-ea8b-4bc5-aa47-d87bd39ad314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:56 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Volume 664557af-6fba-49d8-bc97-e4d0a437841f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664557af-6fba-49d8-bc97-e4d0a437841f', 'volume_size': 1}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:57:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1653029721',display_name='tempest-VolumesGetTest-Volume-1493425389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664557af-6fba-49d8-bc97-e4d0a437841f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b94b3e173eb4582b35926e1aba94363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:57:56Z,use_quota=True,user_id='0670ba5c89564ff4ad5caa50c2cbcff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Creating volume 664557af-6fba-49d8-bc97-e4d0a437841f {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:57:56 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:56 devstack sudo[89960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f 1073741824
Apr 06 16:57:56 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:56 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f 1073741824" returned: 0 in 0.462s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:56 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f
Apr 06 16:57:56 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:57 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f" returned: 0 in 0.390s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773ecc2e-ea8b-4bc5-aa47-d87bd39ad314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664557af-6fba-49d8-bc97-e4d0a437841f', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e65f3c-aafa-4704-aa9d-af84ff0fa09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:57:57 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Volume volume-664557af-6fba-49d8-bc97-e4d0a437841f (664557af-6fba-49d8-bc97-e4d0a437841f): created successfully
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e65f3c-aafa-4704-aa9d-af84ff0fa09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Flow 'volume_create_manager' (ffbd6862-0531-4b85-af9d-6cafb122d2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:57:57 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8955a345-185e-412d-985c-98ab1352e053 tempest-VolumesGetTest-1236250106 None] Created volume successfully.
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-664557af-6fba-49d8-bc97-e4d0a437841f-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Lock "cinder-664557af-6fba-49d8-bc97-e4d0a437841f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-664557af-6fba-49d8-bc97-e4d0a437841f" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-664557af-6fba-49d8-bc97-e4d0a437841f" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca864be2-bd0d-485e-8f6d-631d40cc5007]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:57 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f
Apr 06 16:57:57 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:57 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f" returned: 0 in 0.452s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:57 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f
Apr 06 16:57:57 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:58 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-664557af-6fba-49d8-bc97-e4d0a437841f" returned: 0 in 0.390s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-664557af-6fba-49d8-bc97-e4d0a437841f" released by "delete_volume" :: held 0.865s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Created reservations ['1f60015e-69a7-4564-9fd4-cb16c43719a3', 'a90bc33a-6b9d-40e9-86c2-1e3eecdd36fc', '438f47f3-e263-452a-9d92-f65c054a5501', '7698d1ee-2100-4549-8250-9605fa2d5f36'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:58 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:58 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Lock "cinder-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Acquiring lock "cinder-quobyte-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5959e61-20d1-4cb0-b8fb-e95a43486177]: (4, 'raw') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:58 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:58 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:58 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.431s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:57:58 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:57:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-df94dd7b-1b1d-495e-a8c5-d8777246dd67 tempest-VolumesGetTest-1236250106 None] Lock "cinder-664557af-6fba-49d8-bc97-e4d0a437841f-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:59 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 0 in 0.472s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:59 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:59 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:59 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 1 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154' failed. Not Retrying. {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:59 devstack sudo[89988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154
Apr 06 16:57:59 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:57:59 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" returned: 0 in 0.408s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Lock "cinder-quobyte-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154" released by "delete_volume" :: held 1.364s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Created reservations ['01c60f3b-e063-4543-9e29-96f2435f276f', '50561b5a-e7f2-4b59-a36c-6f4805af7fcb', 'ea58b607-40c7-4f6c-9b72-8745f2f755d6', '6e4a9e89-59f2-4868-87d6-8f1137ca44cf'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:57:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:57:59 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:57:59 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:00 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.403s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:00 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Deleted volume successfully.
Apr 06 16:58:00 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c4b78977-548f-4f60-9b54-b16fc39fd333 tempest-VolumesGetTest-1236250106 None] Lock "cinder-c8c2b9c4-7fc9-4a3d-9ea2-ec6dccc98154-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Flow 'volume_create_manager' (b6168a8a-23a0-407b-854a-2ab1ffeb78ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef345710-df87-4b1f-9c5c-7bb3d26f0b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef345710-df87-4b1f-9c5c-7bb3d26f0b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1977772429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eb38de-b807-47de-819e-08b8252252c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d26a3c7397c4d8787bdbc524cacb524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:02Z,use_quota=True,user_id='0bc7de4e9cf14955be49caf70d318be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a1a73b-bb3f-4ff1-ac80-02716d66d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a1a73b-bb3f-4ff1-ac80-02716d66d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3723b2-799a-4568-9ede-bc8bc83fdae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3723b2-799a-4568-9ede-bc8bc83fdae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37eb38de-b807-47de-819e-08b8252252c3', 'volume_name': 'volume-37eb38de-b807-47de-819e-08b8252252c3', 'volume_size': 2}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f327d485-ebab-4e09-ae54-1cfe28cd6632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f327d485-ebab-4e09-ae54-1cfe28cd6632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73df2084-8e75-4eb1-bd1c-d3efd94f5809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Volume 37eb38de-b807-47de-819e-08b8252252c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37eb38de-b807-47de-819e-08b8252252c3', 'volume_size': 2}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1977772429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eb38de-b807-47de-819e-08b8252252c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d26a3c7397c4d8787bdbc524cacb524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:02Z,use_quota=True,user_id='0bc7de4e9cf14955be49caf70d318be9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Creating volume 37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:02 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 2147483648 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:02 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 2147483648
Apr 06 16:58:02 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:02 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 2147483648" returned: 0 in 0.462s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:02 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3
Apr 06 16:58:02 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:03 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3" returned: 0 in 0.402s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73df2084-8e75-4eb1-bd1c-d3efd94f5809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37eb38de-b807-47de-819e-08b8252252c3', 'volume_size': 2}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dec8a8-8a88-416f-98f6-32460d57a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:03 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Volume volume-37eb38de-b807-47de-819e-08b8252252c3 (37eb38de-b807-47de-819e-08b8252252c3): created successfully
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dec8a8-8a88-416f-98f6-32460d57a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Flow 'volume_create_manager' (b6168a8a-23a0-407b-854a-2ab1ffeb78ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d105b7e3-49a3-482f-a01d-ee7bcf647df0 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Created volume successfully.
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Creating offline snapshot 3c1cd25b-2b50-430f-9653-9e0e1ade171c of volume 37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[36078b16-885b-4506-93d4-e1ade866af1c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:03 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3
Apr 06 16:58:03 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:03 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:03 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:04 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c 2G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:04 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c 2G
Apr 06 16:58:04 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:04 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.411s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:04 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c 2G" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eb38de-b807-47de-819e-08b8252252c3 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:04 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eb38de-b807-47de-819e-08b8252252c3 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c
Apr 06 16:58:04 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:04 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eb38de-b807-47de-819e-08b8252252c3 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c" returned: 0 in 0.415s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:04 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c is being set with open permissions: ugo+rw
Apr 06 16:58:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:04 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c
Apr 06 16:58:04 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:05 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c" returned: 0 in 0.393s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:05 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info
Apr 06 16:58:05 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:05 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:05 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info is being set with open permissions: ugo+rw
Apr 06 16:58:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:05 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info
Apr 06 16:58:05 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:06 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.info" returned: 0 in 0.385s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5f2a138a-d829-403f-aa0e-01e22ab2d5e1 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Create snapshot completed successfully
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "cinder-3c1cd25b-2b50-430f-9653-9e0e1ade171c-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-3c1cd25b-2b50-430f-9653-9e0e1ade171c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "cinder-quobyte-37eb38de-b807-47de-819e-08b8252252c3" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-quobyte-37eb38de-b807-47de-819e-08b8252252c3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "cinder-quobyte-3c1cd25b-2b50-430f-9653-9e0e1ade171c" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-quobyte-3c1cd25b-2b50-430f-9653-9e0e1ade171c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Deleting offline snapshot 3c1cd25b-2b50-430f-9653-9e0e1ade171c of volume 37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] snapshot_file for this snap is: volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca234e-733a-49d9-b31d-134149298a48]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:06 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c
Apr 06 16:58:06 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:07 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c" returned: 0 in 0.457s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37eb38de-b807-47de-819e-08b8252252c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:58:07 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0716d36-eca9-456b-b57e-81c1b2af3db9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:07 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3
Apr 06 16:58:07 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:07 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3" returned: 0 in 0.443s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:07 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c
Apr 06 16:58:07 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:08 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:08 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c
Apr 06 16:58:08 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:08 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3.3c1cd25b-2b50-430f-9653-9e0e1ade171c" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-quobyte-3c1cd25b-2b50-430f-9653-9e0e1ade171c" released by "_delete_snapshot" :: held 1.758s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-quobyte-37eb38de-b807-47de-819e-08b8252252c3" released by "delete_snapshot" :: held 1.770s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Created reservations ['afc17e26-0b06-4661-9310-e5c0d2e6bee2', '2418e9b7-a16e-49b7-8a23-91812758c1a3', 'abf0a1ed-e83e-4516-8d6e-dc42ce5658c9', 'f484483d-5b0e-4b8a-8351-d84975dd72cd'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Delete snapshot completed successfully.
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ffd673e2-ce2b-451b-9366-b6d091726bd9 tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-3c1cd25b-2b50-430f-9653-9e0e1ade171c-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "cinder-37eb38de-b807-47de-819e-08b8252252c3-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-37eb38de-b807-47de-819e-08b8252252c3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "cinder-quobyte-37eb38de-b807-47de-819e-08b8252252c3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-quobyte-37eb38de-b807-47de-819e-08b8252252c3" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b0fd5b-a51c-4477-9fe7-dbffd929fc5b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:08 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3
Apr 06 16:58:08 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:09 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:09 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3
Apr 06 16:58:09 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:09 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-37eb38de-b807-47de-819e-08b8252252c3" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-quobyte-37eb38de-b807-47de-819e-08b8252252c3" released by "delete_volume" :: held 0.862s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Created reservations ['c14ccb51-e8d7-4817-ada6-2d0b493052d6', 'e7285e2d-3912-4eb7-8139-2b5130e65628', '6bc5738d-ac32-4c2e-8398-82f1327b0285', '23a0eb2a-5da5-478f-8ba9-d8c73289447f'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:09 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:09 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:10 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.438s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:10 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Deleted volume successfully.
Apr 06 16:58:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-48f5c00d-c0e0-40e0-98e7-e8a70d706e9f tempest-VolumesSnapshotNegativeTestJSON-1740673343 None] Lock "cinder-37eb38de-b807-47de-819e-08b8252252c3-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (b583c481-a4bc-4335-9c92-5874ef7e3906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0342e6-577b-4ebd-a452-97bfff61d705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0342e6-577b-4ebd-a452-97bfff61d705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1658998752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66a853d-4a7a-45dc-a9e9-3586cad74208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:12Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e55fb9-4f83-4299-8341-a5b961af4ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e55fb9-4f83-4299-8341-a5b961af4ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458deeaf-0f95-4c80-b521-4bc02360d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458deeaf-0f95-4c80-b521-4bc02360d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f66a853d-4a7a-45dc-a9e9-3586cad74208', 'volume_name': 'volume-f66a853d-4a7a-45dc-a9e9-3586cad74208', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772b41f4-59dc-4503-b32b-4a923554f756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772b41f4-59dc-4503-b32b-4a923554f756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bb708e-b66f-42ff-b429-5b4eb5b3183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:11 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume f66a853d-4a7a-45dc-a9e9-3586cad74208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f66a853d-4a7a-45dc-a9e9-3586cad74208', 'volume_size': 1}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1658998752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66a853d-4a7a-45dc-a9e9-3586cad74208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:12Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Creating volume f66a853d-4a7a-45dc-a9e9-3586cad74208 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:11 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:11 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 1073741824
Apr 06 16:58:11 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:12 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 1073741824" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:12 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208
Apr 06 16:58:12 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:12 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208" returned: 0 in 0.395s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bb708e-b66f-42ff-b429-5b4eb5b3183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66a853d-4a7a-45dc-a9e9-3586cad74208', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d610c820-e597-4172-832f-075905157fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:12 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 (f66a853d-4a7a-45dc-a9e9-3586cad74208): created successfully
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d610c820-e597-4172-832f-075905157fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (b583c481-a4bc-4335-9c92-5874ef7e3906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5ecedb78-838f-4b50-b2c7-48093217eb9a tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created volume successfully.
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (b8be8def-03b6-438a-923a-9a5d2e70e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a8a452-df24-4b32-a467-e9057a002835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a8a452-df24-4b32-a467-e9057a002835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1637021303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:13Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86403ba7-1ad6-488a-b600-d28517d3e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86403ba7-1ad6-488a-b600-d28517d3e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7323f0cf-b0f3-41eb-b95b-acb4c7cfc33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7323f0cf-b0f3-41eb-b95b-acb4c7cfc33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9', 'volume_name': 'volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b423c329-bb24-4d01-a59a-6cd429ff5355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b423c329-bb24-4d01-a59a-6cd429ff5355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705b1e90-86e2-40ba-863e-cd764c72b4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume 0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9', 'volume_size': 1}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1637021303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:13Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Creating volume 0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:13 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:13 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 1073741824
Apr 06 16:58:13 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (b79bbd1a-6b2d-4a65-bda7-d2eb0dc6a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f511e256-9f3e-4536-9e9a-2c6478b649a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f511e256-9f3e-4536-9e9a-2c6478b649a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1353259363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89afed5c-4109-41db-b9d5-416c30e68979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:13Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee2fd9f-22df-476e-87cb-1a795d376098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee2fd9f-22df-476e-87cb-1a795d376098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904dfa29-f98a-4d7f-ab1e-e2b439bba497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904dfa29-f98a-4d7f-ab1e-e2b439bba497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89afed5c-4109-41db-b9d5-416c30e68979', 'volume_name': 'volume-89afed5c-4109-41db-b9d5-416c30e68979', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151f81cc-b8f5-414e-8fd6-feb48cddf247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151f81cc-b8f5-414e-8fd6-feb48cddf247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f013095f-a6c3-4100-89f2-50b810177783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume 89afed5c-4109-41db-b9d5-416c30e68979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89afed5c-4109-41db-b9d5-416c30e68979', 'volume_size': 1}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (ec6024e3-ac25-4edf-8b78-9356b0ef299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4c5243-02ad-4823-8b1b-42dbd19f183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4c5243-02ad-4823-8b1b-42dbd19f183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783481774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f534c9d-bd47-4810-8ffb-72dc739914d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:13Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36541cd-0447-4c66-94c9-92c663dd4318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36541cd-0447-4c66-94c9-92c663dd4318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579347f1-7719-4f4f-83fe-392f77093da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579347f1-7719-4f4f-83fe-392f77093da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f534c9d-bd47-4810-8ffb-72dc739914d2', 'volume_name': 'volume-4f534c9d-bd47-4810-8ffb-72dc739914d2', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5545285-3350-43c8-a9de-100a0feddcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5545285-3350-43c8-a9de-100a0feddcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f1a775-b681-4a50-bac6-67e6c7654bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume 4f534c9d-bd47-4810-8ffb-72dc739914d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f534c9d-bd47-4810-8ffb-72dc739914d2', 'volume_size': 1}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:13 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 1073741824" returned: 0 in 0.554s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:13 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9
Apr 06 16:58:13 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (0cd233d9-5623-4a67-8fc9-0f3c9e50c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27c752b-2bd4-4a0a-807b-3246f521931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27c752b-2bd4-4a0a-807b-3246f521931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522082710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100d4ebe-c878-489a-b09f-42e56de1dcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:14Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03c4636-53ba-4895-b6cc-46eadb5da5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03c4636-53ba-4895-b6cc-46eadb5da5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25710dfa-80f3-4c5c-a0a5-62b70cccf937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25710dfa-80f3-4c5c-a0a5-62b70cccf937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100d4ebe-c878-489a-b09f-42e56de1dcb0', 'volume_name': 'volume-100d4ebe-c878-489a-b09f-42e56de1dcb0', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cccc82-e8ac-4a17-a6b6-b20b81a8933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cccc82-e8ac-4a17-a6b6-b20b81a8933b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28dacbe2-e0eb-4845-a635-9b8c5f516713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:13 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume 100d4ebe-c878-489a-b09f-42e56de1dcb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100d4ebe-c878-489a-b09f-42e56de1dcb0', 'volume_size': 1}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (f1e3e14a-b454-412c-a0eb-f524d71c1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:13 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feff95b0-7987-4af7-b1b1-dfde28279548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feff95b0-7987-4af7-b1b1-dfde28279548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1933510999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1982cc7-c3f5-4759-a6ee-2441ab9c35e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:14Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d3339a-9e3c-42d8-afc0-f518c3d443cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d3339a-9e3c-42d8-afc0-f518c3d443cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af02d673-b15b-4fbb-ba1d-1fcfada31635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af02d673-b15b-4fbb-ba1d-1fcfada31635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1982cc7-c3f5-4759-a6ee-2441ab9c35e1', 'volume_name': 'volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3845ce29-d0ce-4e27-b0f0-b3e1674a0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3845ce29-d0ce-4e27-b0f0-b3e1674a0bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce996a5-5956-4c2b-947a-91548774c3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume c1982cc7-c3f5-4759-a6ee-2441ab9c35e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1', 'volume_size': 1}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9" returned: 0 in 0.424s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1353259363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89afed5c-4109-41db-b9d5-416c30e68979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:13Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Creating volume 89afed5c-4109-41db-b9d5-416c30e68979 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705b1e90-86e2-40ba-863e-cd764c72b4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979 1073741824
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986d06c3-e3a4-440b-bae9-2b2e9404f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 (0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9): created successfully
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986d06c3-e3a4-440b-bae9-2b2e9404f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (b8be8def-03b6-438a-923a-9a5d2e70e415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a2d743db-b451-4fc1-aeca-9f8d35bfc154 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created volume successfully.
Apr 06 16:58:14 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979 1073741824" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:14 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979
Apr 06 16:58:14 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:14 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979" returned: 0 in 0.392s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783481774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f534c9d-bd47-4810-8ffb-72dc739914d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:13Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Creating volume 4f534c9d-bd47-4810-8ffb-72dc739914d2 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f013095f-a6c3-4100-89f2-50b810177783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89afed5c-4109-41db-b9d5-416c30e68979', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67349ac-6b44-4ec7-a243-ab0f5661cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:14 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 1073741824
Apr 06 16:58:14 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume volume-89afed5c-4109-41db-b9d5-416c30e68979 (89afed5c-4109-41db-b9d5-416c30e68979): created successfully
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a67349ac-6b44-4ec7-a243-ab0f5661cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (b79bbd1a-6b2d-4a65-bda7-d2eb0dc6a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-bc048ada-96d4-4496-b6b6-74d7af4775fd tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created volume successfully.
Apr 06 16:58:15 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 1073741824" returned: 0 in 0.472s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:15 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2
Apr 06 16:58:15 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:15 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2" returned: 0 in 0.388s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522082710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100d4ebe-c878-489a-b09f-42e56de1dcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:14Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Creating volume 100d4ebe-c878-489a-b09f-42e56de1dcb0 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:15 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f1a775-b681-4a50-bac6-67e6c7654bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f534c9d-bd47-4810-8ffb-72dc739914d2', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:15 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 1073741824
Apr 06 16:58:15 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee567ea-854a-414e-bf8c-827897afab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:15 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 (4f534c9d-bd47-4810-8ffb-72dc739914d2): created successfully
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee567ea-854a-414e-bf8c-827897afab69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (ec6024e3-ac25-4edf-8b78-9356b0ef299b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c6541a5f-c2b2-445f-8720-ebd23fc83c69 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created volume successfully.
Apr 06 16:58:16 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 1073741824" returned: 0 in 0.470s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:16 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0
Apr 06 16:58:16 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:16 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0" returned: 0 in 0.390s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.660s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1933510999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1982cc7-c3f5-4759-a6ee-2441ab9c35e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8b753de13d94fc8bd17ffa2d5e8bd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:14Z,use_quota=True,user_id='3a87917266f74e9faa7df84c5b3bd8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Creating volume c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:16 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28dacbe2-e0eb-4845-a635-9b8c5f516713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100d4ebe-c878-489a-b09f-42e56de1dcb0', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:16 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 1073741824
Apr 06 16:58:16 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f57a29c-4839-4e5a-b3e9-1279664cb57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:16 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 (100d4ebe-c878-489a-b09f-42e56de1dcb0): created successfully
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f57a29c-4839-4e5a-b3e9-1279664cb57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (0cd233d9-5623-4a67-8fc9-0f3c9e50c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:16 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6510e794-980e-4615-bd1d-39b2b89ba975 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created volume successfully.
Apr 06 16:58:17 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 1073741824" returned: 0 in 0.474s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:17 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1
Apr 06 16:58:17 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:17 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1" returned: 0 in 0.410s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce996a5-5956-4c2b-947a-91548774c3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefc543f-be0b-41a5-bdd7-93e7820ea6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:17 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Volume volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 (c1982cc7-c3f5-4759-a6ee-2441ab9c35e1): created successfully
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefc543f-be0b-41a5-bdd7-93e7820ea6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:17 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Flow 'volume_create_manager' (f1e3e14a-b454-412c-a0eb-f524d71c1c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f1268d57-2834-4294-84b9-63d2647d5fa5 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created volume successfully.
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-quobyte-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d818ec-4d77-4c3d-8634-14656cdb680d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:18 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1
Apr 06 16:58:18 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:18 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:18 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1
Apr 06 16:58:18 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:19 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1" returned: 0 in 0.417s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1" released by "delete_volume" :: held 0.877s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created reservations ['8079bfc8-eb60-48eb-828c-97da560bdd3e', '14f3af9d-1876-42e5-b3c3-bbe27c4a315b', '878aa7d9-3740-437b-b9fd-5552d3724f74', '67480096-873c-4b6a-97d3-60aa653dbb66'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:19 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:19 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-100d4ebe-c878-489a-b09f-42e56de1dcb0-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-100d4ebe-c878-489a-b09f-42e56de1dcb0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-quobyte-100d4ebe-c878-489a-b09f-42e56de1dcb0" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-100d4ebe-c878-489a-b09f-42e56de1dcb0" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6f5cc-1a7d-450d-af0c-19bee23177b6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:19 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0
Apr 06 16:58:19 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:19 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:19 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Deleted volume successfully.
Apr 06 16:58:19 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-ac56023e-f4f5-467f-a820-9c6657302e02 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-c1982cc7-c3f5-4759-a6ee-2441ab9c35e1-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:20 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0" returned: 0 in 0.464s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:20 devstack sudo[90140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0
Apr 06 16:58:20 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:20 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-100d4ebe-c878-489a-b09f-42e56de1dcb0" returned: 0 in 0.390s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-100d4ebe-c878-489a-b09f-42e56de1dcb0" released by "delete_volume" :: held 0.873s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created reservations ['ef36f9de-dd28-4322-9bcf-ab5d977c241c', 'd8965974-a529-4836-864a-574337f7e990', '0b787b06-9d53-4b79-9de6-250ce9730344', 'ced9ee58-e745-4751-a4b5-98572dd6eba7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:20 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:20 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-4f534c9d-bd47-4810-8ffb-72dc739914d2-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-4f534c9d-bd47-4810-8ffb-72dc739914d2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-quobyte-4f534c9d-bd47-4810-8ffb-72dc739914d2" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-4f534c9d-bd47-4810-8ffb-72dc739914d2" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c7db0-7319-4a20-bcf8-92971c67fa2e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:20 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2
Apr 06 16:58:20 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:20 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:20 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Deleted volume successfully.
Apr 06 16:58:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d4d94c26-f6eb-4594-9ac2-1e38f96d2e5c tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-100d4ebe-c878-489a-b09f-42e56de1dcb0-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:21 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:21 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2
Apr 06 16:58:21 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:21 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4f534c9d-bd47-4810-8ffb-72dc739914d2" returned: 0 in 0.390s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-4f534c9d-bd47-4810-8ffb-72dc739914d2" released by "delete_volume" :: held 0.861s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created reservations ['2f28c4c4-be88-44e6-a208-de1fdf3ace3c', '6c63abb2-95ab-4e56-be32-6de189ae752b', '25e184c4-5548-400a-aed4-a1bf99ea7539', '8a8a8736-df2f-4bf5-8518-ab1904bc6dec'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:21 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:21 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-89afed5c-4109-41db-b9d5-416c30e68979-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-89afed5c-4109-41db-b9d5-416c30e68979-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-quobyte-89afed5c-4109-41db-b9d5-416c30e68979" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-89afed5c-4109-41db-b9d5-416c30e68979" acquired by "delete_volume" :: waited 0.019s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d71e94-1872-426b-9ecc-31a9ad8f7791]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:21 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979
Apr 06 16:58:21 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:21 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.404s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:21 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Deleted volume successfully.
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-06d88768-d9e9-478a-acd8-023ec934bf90 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-4f534c9d-bd47-4810-8ffb-72dc739914d2-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:22 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:22 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979
Apr 06 16:58:22 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:22 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89afed5c-4109-41db-b9d5-416c30e68979" returned: 0 in 0.401s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-89afed5c-4109-41db-b9d5-416c30e68979" released by "delete_volume" :: held 0.880s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created reservations ['acd68ef2-08f5-41f2-a318-db6118b89a55', 'c06729f1-5c7f-4836-868c-d4d43992047c', '4177cb23-4c57-4037-92b5-78280781f3c5', 'f54a335b-85f3-4da2-9a79-89813e4f7a4b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:22 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:22 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-quobyte-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27abcc2d-fa4d-4501-ba96-1bb44152fa3f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:22 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9
Apr 06 16:58:22 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:23 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:23 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Deleted volume successfully.
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cd26947f-1294-4c02-b362-e84836cf9230 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-89afed5c-4109-41db-b9d5-416c30e68979-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:23 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9" returned: 0 in 0.457s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:23 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9
Apr 06 16:58:23 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:23 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9" returned: 0 in 0.394s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9" released by "delete_volume" :: held 0.870s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=129,cinder:UPDATE=140,cinder:INSERT=51,cinder:DELETE=16 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=103,cinder:INSERT=36,cinder:UPDATE=178,cinder:DELETE=13 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created reservations ['2231bd86-34ec-486f-98b9-1c58bd4fb5e1', '82cceb99-127c-48e4-9d31-4537c7c93a08', '74eeb13e-707c-43b8-9226-c0b5f89da89b', '69511fc9-faf8-4bd1-b1b1-94e1fcf3db48'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:23 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:23 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-f66a853d-4a7a-45dc-a9e9-3586cad74208-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-f66a853d-4a7a-45dc-a9e9-3586cad74208-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "cinder-quobyte-f66a853d-4a7a-45dc-a9e9-3586cad74208" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-f66a853d-4a7a-45dc-a9e9-3586cad74208" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[57510e83-b174-4250-9b97-6af09fd7635c]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:24 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208
Apr 06 16:58:24 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:24 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Deleted volume successfully.
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-fc0ace89-4d94-4a51-a7fd-27ba75ab4d41 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-0fef1f07-e8ea-42cd-a4b5-ac7ab284bfa9-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:24 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:24 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208
Apr 06 16:58:24 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:24 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-f66a853d-4a7a-45dc-a9e9-3586cad74208" returned: 0 in 0.385s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-quobyte-f66a853d-4a7a-45dc-a9e9-3586cad74208" released by "delete_volume" :: held 0.855s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Created reservations ['a1ef4507-5dbb-469c-9953-55cc4732a427', 'bbb7afe5-904d-4db9-a941-7cee93aabad0', '8be4baa1-d350-43ce-8420-7d4b6268392e', '7d9c4948-b3e9-46c4-bbe0-4d41c3c4096b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:24 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:24 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:25 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:25 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Deleted volume successfully.
Apr 06 16:58:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-46fbccb2-12c5-45ad-ad8e-1ec959076516 tempest-CreateVolumesFromSourceVolumeTest-1139676043 None] Lock "cinder-f66a853d-4a7a-45dc-a9e9-3586cad74208-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (6617ce6b-90bc-4804-9858-7fdd1f38b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ae597a-c986-4748-ad42-3a8a499d791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ae597a-c986-4748-ad42-3a8a499d791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-583128695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1625c8ff-eabf-4f5d-93f8-34cc8033fbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8236859bc04474b25934f0a691f3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:27Z,use_quota=True,user_id='4bbd8fe95dca466488c10119b758f76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3920bebc-df7c-456b-bb96-910a31acf1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3920bebc-df7c-456b-bb96-910a31acf1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911764e7-1e03-45c8-bf30-dc7b3a0b5239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911764e7-1e03-45c8-bf30-dc7b3a0b5239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1625c8ff-eabf-4f5d-93f8-34cc8033fbce', 'volume_name': 'volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ca2ed2-d5ec-4610-8195-dd58f114e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ca2ed2-d5ec-4610-8195-dd58f114e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6138d760-5b76-4999-9b15-540865e20e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Volume 1625c8ff-eabf-4f5d-93f8-34cc8033fbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce', 'volume_size': 1}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-583128695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1625c8ff-eabf-4f5d-93f8-34cc8033fbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8236859bc04474b25934f0a691f3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:27Z,use_quota=True,user_id='4bbd8fe95dca466488c10119b758f76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Creating volume 1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:26 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:26 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce 1073741824
Apr 06 16:58:26 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:27 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce 1073741824" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:27 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:27 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:27 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.385s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6138d760-5b76-4999-9b15-540865e20e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f6b046-fc18-4f8b-a00e-e35b51e1aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:27 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Volume volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce (1625c8ff-eabf-4f5d-93f8-34cc8033fbce): created successfully
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f6b046-fc18-4f8b-a00e-e35b51e1aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (6617ce6b-90bc-4804-9858-7fdd1f38b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:27 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5c4fd23d-2cbc-4ac7-8075-9d104472f24e tempest-VolumeDependencyTests-165453225 None] Created volume successfully.
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Creating offline snapshot 774cb595-a5b3-482a-8b36-f31686148905 of volume 1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba2aacb-d42f-45ee-9ebc-504e3595339d]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:27 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:27 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:27 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:28 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.434s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:28 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 1G
Apr 06 16:58:28 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:28 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 1G" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:28 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905
Apr 06 16:58:28 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:29 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905" returned: 0 in 0.402s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:29 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 is being set with open permissions: ugo+rw
Apr 06 16:58:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:29 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905
Apr 06 16:58:29 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:29 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905" returned: 0 in 0.368s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:29 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info
Apr 06 16:58:29 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:29 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info" returned: 0 in 0.378s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:29 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info is being set with open permissions: ugo+rw
Apr 06 16:58:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:29 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info
Apr 06 16:58:29 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:30 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.info" returned: 0 in 0.364s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5422d4d8-9ffc-4d3f-8020-d83e25978b96 tempest-VolumeDependencyTests-165453225 None] Create snapshot completed successfully
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (97109211-1dfe-41db-80cf-2682cb1b6bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6409f94a-1e78-42d3-9d3e-6f5e16974374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6409f94a-1e78-42d3-9d3e-6f5e16974374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2047011499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb88168-8eca-4ada-ac38-e3825af6092c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8236859bc04474b25934f0a691f3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=774cb595-a5b3-482a-8b36-f31686148905,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:31Z,use_quota=True,user_id='4bbd8fe95dca466488c10119b758f76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40715b67-ddea-47fa-a09d-f54179d73221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40715b67-ddea-47fa-a09d-f54179d73221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44891f4c-1aec-4d37-aa17-5505d19f585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44891f4c-1aec-4d37-aa17-5505d19f585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cb88168-8eca-4ada-ac38-e3825af6092c', 'volume_name': 'volume-5cb88168-8eca-4ada-ac38-e3825af6092c', 'volume_size': 1, 'snapshot_id': '774cb595-a5b3-482a-8b36-f31686148905'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c82d30-49a2-4295-8460-4ddfe0387d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c82d30-49a2-4295-8460-4ddfe0387d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b8eb49-b9de-4672-9ccb-674b157f711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:31 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Volume 5cb88168-8eca-4ada-ac38-e3825af6092c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cb88168-8eca-4ada-ac38-e3825af6092c', 'volume_size': 1, 'snapshot_id': '774cb595-a5b3-482a-8b36-f31686148905'}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-774cb595-a5b3-482a-8b36-f31686148905-5cb88168-8eca-4ada-ac38-e3825af6092c" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-774cb595-a5b3-482a-8b36-f31686148905-5cb88168-8eca-4ada-ac38-e3825af6092c" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Creating volume 5cb88168-8eca-4ada-ac38-e3825af6092c from snapshot 774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-5cb88168-8eca-4ada-ac38-e3825af6092c" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-5cb88168-8eca-4ada-ac38-e3825af6092c" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] snapshot: 774cb595-a5b3-482a-8b36-f31686148905, volume: 5cb88168-8eca-4ada-ac38-e3825af6092c,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81a6279-ebca-4036-8174-6c87a0191c85]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:31 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905
Apr 06 16:58:31 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:31 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb12b71-6d88-4a44-81ca-aadb8ed31584]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:31 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:31 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:32 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:32 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:58:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:32 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c
Apr 06 16:58:32 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:34 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c" returned: 0 in 1.931s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:34 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[77237df9-a4ab-4b40-8b8f-5225b8339fea]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:34 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:34 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:34 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.554s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:34 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:58:34 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Converted 1024.00 MB image at 530.06 MB/s
Apr 06 16:58:34 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c is being set with open permissions: ugo+rw
Apr 06 16:58:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:34 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c
Apr 06 16:58:34 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:35 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c" returned: 0 in 0.367s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-5cb88168-8eca-4ada-ac38-e3825af6092c" released by "_copy_volume_from_snapshot" :: held 3.788s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-774cb595-a5b3-482a-8b36-f31686148905-5cb88168-8eca-4ada-ac38-e3825af6092c" released by "_create_volume_from_snapshot" :: held 3.802s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.809s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b8eb49-b9de-4672-9ccb-674b157f711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb88168-8eca-4ada-ac38-e3825af6092c', 'volume_size': 1, 'snapshot_id': '774cb595-a5b3-482a-8b36-f31686148905'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46db0136-8b71-4fc7-943c-52ff5e4cb680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:35 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Volume volume-5cb88168-8eca-4ada-ac38-e3825af6092c (5cb88168-8eca-4ada-ac38-e3825af6092c): created successfully
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46db0136-8b71-4fc7-943c-52ff5e4cb680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (97109211-1dfe-41db-80cf-2682cb1b6bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:35 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c9703911-8f88-4d37-83b2-35eebec8366a tempest-VolumeDependencyTests-165453225 None] Created volume successfully.
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-774cb595-a5b3-482a-8b36-f31686148905-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Lock "cinder-774cb595-a5b3-482a-8b36-f31686148905-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-774cb595-a5b3-482a-8b36-f31686148905" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-774cb595-a5b3-482a-8b36-f31686148905" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Deleting offline snapshot 774cb595-a5b3-482a-8b36-f31686148905 of volume 1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] snapshot_file for this snap is: volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[91315698-2007-4a7e-b9c5-5a516548315a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:35 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905
Apr 06 16:58:35 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:35 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905" returned: 0 in 0.452s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d89118-2309-471f-9597-2a0bdb2f7904]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:36 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:36 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:36 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.452s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:36 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905
Apr 06 16:58:36 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:36 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905" returned: 0 in 0.434s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:36 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905
Apr 06 16:58:36 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:37 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce.774cb595-a5b3-482a-8b36-f31686148905" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-774cb595-a5b3-482a-8b36-f31686148905" released by "_delete_snapshot" :: held 1.785s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" released by "delete_snapshot" :: held 1.797s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Created reservations ['5ac486a5-9fd1-443f-b192-4c2f05f6e215', 'f79c9a56-9f80-470a-924d-fe6f2c52d82c', 'afa4c190-5734-41ab-b4b5-61e443cd3b9a', '19f4a47b-e4e9-48df-b4ca-03098c11c40c'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:37 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Delete snapshot completed successfully.
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9d4e1102-d3a9-4d9b-b682-6d7aec43601f tempest-VolumeDependencyTests-165453225 None] Lock "cinder-774cb595-a5b3-482a-8b36-f31686148905-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-1625c8ff-eabf-4f5d-93f8-34cc8033fbce-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-1625c8ff-eabf-4f5d-93f8-34cc8033fbce-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3be5b15-e6e5-423d-817f-d02e3a1c1710]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:37 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:37 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:38 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.433s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:38 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce
Apr 06 16:58:38 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:38 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" returned: 0 in 0.380s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-1625c8ff-eabf-4f5d-93f8-34cc8033fbce" released by "delete_volume" :: held 0.842s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Created reservations ['b46c657a-1ff9-44f5-b990-65fc5952b900', '226f51c2-8a50-4699-90ce-2708b476f29e', '128af025-7f7c-451a-8985-165b49f8911d', '5d4669ca-8d14-482a-a8e8-3d9fdbc991e6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:38 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:38 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (6aff3227-af27-414e-b6a0-62b73bb147ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc624570-f848-4e2b-abc9-3e4be580bbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc624570-f848-4e2b-abc9-3e4be580bbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2117001190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05776a50-375b-499c-a8cb-196a0cc15784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8236859bc04474b25934f0a691f3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:39Z,use_quota=True,user_id='4bbd8fe95dca466488c10119b758f76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e961e19-1246-4bce-b51f-e10de4830bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e961e19-1246-4bce-b51f-e10de4830bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d772ad1-b18c-417c-a1bc-d1d5d4b5ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d772ad1-b18c-417c-a1bc-d1d5d4b5ff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05776a50-375b-499c-a8cb-196a0cc15784', 'volume_name': 'volume-05776a50-375b-499c-a8cb-196a0cc15784', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:38 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2b050a-23a3-4e2c-9f6c-bc49f9a8f646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2b050a-23a3-4e2c-9f6c-bc49f9a8f646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee0af1c-1ffe-470b-9fc3-f063c1161cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:38 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Volume 05776a50-375b-499c-a8cb-196a0cc15784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05776a50-375b-499c-a8cb-196a0cc15784', 'volume_size': 1}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2117001190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05776a50-375b-499c-a8cb-196a0cc15784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8236859bc04474b25934f0a691f3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:39Z,use_quota=True,user_id='4bbd8fe95dca466488c10119b758f76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Creating volume 05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:38 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.458s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:38 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Deleted volume successfully.
Apr 06 16:58:38 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 1073741824
Apr 06 16:58:38 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b4ec2e2a-bec7-46d3-aee6-a9e4c8fe7dd2 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-1625c8ff-eabf-4f5d-93f8-34cc8033fbce-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:39 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 1073741824" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:39 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:39 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:39 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee0af1c-1ffe-470b-9fc3-f063c1161cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05776a50-375b-499c-a8cb-196a0cc15784', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6182fec-4e59-4a6c-aa3c-a25532db81a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:39 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Volume volume-05776a50-375b-499c-a8cb-196a0cc15784 (05776a50-375b-499c-a8cb-196a0cc15784): created successfully
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6182fec-4e59-4a6c-aa3c-a25532db81a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:39 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (6aff3227-af27-414e-b6a0-62b73bb147ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:39 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b953a5d8-c159-47d2-8cfe-85f5f8864cfc tempest-VolumeDependencyTests-165453225 None] Created volume successfully.
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (78b6068d-d4b6-46d3-af04-7cc794b7fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd84070-d5ec-4bd5-9578-3711457f6bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd84070-d5ec-4bd5-9578-3711457f6bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-630935423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bb97a3-22e3-43da-a356-4adc3ea110ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8236859bc04474b25934f0a691f3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=05776a50-375b-499c-a8cb-196a0cc15784,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:40Z,use_quota=True,user_id='4bbd8fe95dca466488c10119b758f76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abbae57-ccc9-418d-8011-01d963cbdfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abbae57-ccc9-418d-8011-01d963cbdfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de7c56a-c6c0-4410-8a89-f4ba4d1dc12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de7c56a-c6c0-4410-8a89-f4ba4d1dc12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '80bb97a3-22e3-43da-a356-4adc3ea110ee', 'volume_name': 'volume-80bb97a3-22e3-43da-a356-4adc3ea110ee', 'volume_size': 1, 'source_volid': '05776a50-375b-499c-a8cb-196a0cc15784', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69123a41-740a-4fcb-8cc0-c9a4c6ac1c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69123a41-740a-4fcb-8cc0-c9a4c6ac1c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855c70a2-f00e-4a2b-b687-0122d9a607d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:40 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Volume 80bb97a3-22e3-43da-a356-4adc3ea110ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-80bb97a3-22e3-43da-a356-4adc3ea110ee', 'volume_size': 1, 'source_volid': '05776a50-375b-499c-a8cb-196a0cc15784', 'source_volstatus': 'available'}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:40 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Cloning volume 05776a50-375b-499c-a8cb-196a0cc15784 to volume 80bb97a3-22e3-43da-a356-4adc3ea110ee
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Creating offline snapshot 6b092d4a-84cd-40bb-80ce-9947b981f006 of volume 05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d559e-f367-46a5-9ef8-d885306769f7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:40 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:40 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:40 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:40 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 1G
Apr 06 16:58:40 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:41 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 1G" returned: 0 in 0.453s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05776a50-375b-499c-a8cb-196a0cc15784 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:41 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05776a50-375b-499c-a8cb-196a0cc15784 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006
Apr 06 16:58:41 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:41 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05776a50-375b-499c-a8cb-196a0cc15784 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:41 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 is being set with open permissions: ugo+rw
Apr 06 16:58:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:41 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006
Apr 06 16:58:41 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:41 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:42 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info
Apr 06 16:58:42 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:42 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info" returned: 0 in 0.392s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:42 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info is being set with open permissions: ugo+rw
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:42 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info
Apr 06 16:58:42 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:42 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.info" returned: 0 in 0.368s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-80bb97a3-22e3-43da-a356-4adc3ea110ee" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-80bb97a3-22e3-43da-a356-4adc3ea110ee" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] snapshot: 6b092d4a-84cd-40bb-80ce-9947b981f006, volume: 80bb97a3-22e3-43da-a356-4adc3ea110ee,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236d428-7e5d-4825-9e83-7620c39fabab]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:42 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006
Apr 06 16:58:42 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:43 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05776a50-375b-499c-a8cb-196a0cc15784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd88182-9330-40fe-a162-ae3bf15e1c63]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:43 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:43 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:43 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.431s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:58:43 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:43 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee
Apr 06 16:58:43 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:45 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee" returned: 0 in 2.005s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:45 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd2920-8c29-4e84-bf46-d06c2bef41bd]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:45 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:45 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:46 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.558s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:58:46 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Converted 1024.00 MB image at 510.53 MB/s
Apr 06 16:58:46 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee is being set with open permissions: ugo+rw
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:46 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee
Apr 06 16:58:46 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:46 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee" returned: 0 in 0.402s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-80bb97a3-22e3-43da-a356-4adc3ea110ee" released by "_copy_volume_from_snapshot" :: held 3.886s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-6b092d4a-84cd-40bb-80ce-9947b981f006" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-6b092d4a-84cd-40bb-80ce-9947b981f006" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Deleting offline snapshot 6b092d4a-84cd-40bb-80ce-9947b981f006 of volume 05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] snapshot_file for this snap is: volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8470cead-4628-40f3-82f4-600b7a481070]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:46 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006
Apr 06 16:58:46 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:47 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006" returned: 0 in 0.477s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05776a50-375b-499c-a8cb-196a0cc15784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:58:47 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106349b-3747-4f3b-b0f3-827b4fce6fef]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:47 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:47 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:47 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:47 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006
Apr 06 16:58:47 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:48 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:48 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006
Apr 06 16:58:48 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:48 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784.6b092d4a-84cd-40bb-80ce-9947b981f006" returned: 0 in 0.386s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-6b092d4a-84cd-40bb-80ce-9947b981f006" released by "_delete_snapshot" :: held 1.799s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.224s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855c70a2-f00e-4a2b-b687-0122d9a607d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bb97a3-22e3-43da-a356-4adc3ea110ee', 'volume_size': 1, 'source_volid': '05776a50-375b-499c-a8cb-196a0cc15784', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6258d1-f4e3-4b6a-a3c0-dde0402c2bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:48 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Volume volume-80bb97a3-22e3-43da-a356-4adc3ea110ee (80bb97a3-22e3-43da-a356-4adc3ea110ee): created successfully
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6258d1-f4e3-4b6a-a3c0-dde0402c2bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Flow 'volume_create_manager' (78b6068d-d4b6-46d3-af04-7cc794b7fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:48 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-b3d794ef-fe0b-4256-afdc-cc575489c3f9 tempest-VolumeDependencyTests-165453225 None] Created volume successfully.
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-05776a50-375b-499c-a8cb-196a0cc15784-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Lock "cinder-05776a50-375b-499c-a8cb-196a0cc15784-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-05776a50-375b-499c-a8cb-196a0cc15784" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-05776a50-375b-499c-a8cb-196a0cc15784" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b114ea9-3c16-49d0-a884-10f6f47c4e67]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:48 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:48 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:49 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:49 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784
Apr 06 16:58:49 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:49 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-05776a50-375b-499c-a8cb-196a0cc15784" returned: 0 in 0.387s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-05776a50-375b-499c-a8cb-196a0cc15784" released by "delete_volume" :: held 0.862s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Created reservations ['3395abcd-d65a-47b5-ba31-11bc52fb2b0e', 'de249edb-af34-4c76-b05a-16df7f273bbe', 'e606c2c8-8d1e-4e5c-9a2c-27a986764623', 'a5d7841c-f86a-4ac8-a452-baa9cb91e4cf'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:49 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:49 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-80bb97a3-22e3-43da-a356-4adc3ea110ee-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Lock "cinder-80bb97a3-22e3-43da-a356-4adc3ea110ee-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-80bb97a3-22e3-43da-a356-4adc3ea110ee" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-80bb97a3-22e3-43da-a356-4adc3ea110ee" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af8b8ad-e8f8-43ec-be64-6adeba1c6a18]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:49 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee
Apr 06 16:58:49 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:50 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.416s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Deleted volume successfully.
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f88131c2-7a06-42a7-b29d-cafb6b83c96c tempest-VolumeDependencyTests-165453225 None] Lock "cinder-05776a50-375b-499c-a8cb-196a0cc15784-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:50 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee" returned: 0 in 0.464s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:50 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee
Apr 06 16:58:50 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:50 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-80bb97a3-22e3-43da-a356-4adc3ea110ee" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-80bb97a3-22e3-43da-a356-4adc3ea110ee" released by "delete_volume" :: held 0.883s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Created reservations ['1ee21988-3aa7-4142-a589-8a4c7be298a8', 'eaa02ab6-765a-4dcf-aa02-a267d87eeb1b', '08a8d2c8-ce63-44b3-bf2a-b4814d3462b8', '2d2a02e7-4670-4c09-ac49-c7f17ce95b2a'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:50 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:50 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-5cb88168-8eca-4ada-ac38-e3825af6092c-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-5cb88168-8eca-4ada-ac38-e3825af6092c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "cinder-quobyte-5cb88168-8eca-4ada-ac38-e3825af6092c" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-5cb88168-8eca-4ada-ac38-e3825af6092c" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[970a630c-d1a6-442c-b1f2-3004d9f0bda0]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:58:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:51 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c
Apr 06 16:58:51 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:51 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.405s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:51 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Deleted volume successfully.
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4b315c0d-6b03-42b6-80eb-2b494e05713e tempest-VolumeDependencyTests-165453225 None] Lock "cinder-80bb97a3-22e3-43da-a356-4adc3ea110ee-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:51 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c" returned: 0 in 0.454s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:51 devstack sudo[90417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c
Apr 06 16:58:51 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:51 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5cb88168-8eca-4ada-ac38-e3825af6092c" returned: 0 in 0.381s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-quobyte-5cb88168-8eca-4ada-ac38-e3825af6092c" released by "delete_volume" :: held 0.857s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Created reservations ['5796190a-b924-4cae-91ad-0931eb690d9f', '1702d3be-817e-44a1-8dd0-b4ae173a5d73', '8d5b0364-2092-4684-9fb4-4192da7726aa', '3abc657c-3a55-4316-ae39-6889d6925c4f'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:51 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:58:51 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:52 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 06 16:58:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.431s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:58:52 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:58:52 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Deleted volume successfully.
Apr 06 16:58:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4df444af-4495-4604-bd8b-4e333dfc92e7 tempest-VolumeDependencyTests-165453225 None] Lock "cinder-5cb88168-8eca-4ada-ac38-e3825af6092c-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (d7b749ad-5ccd-466e-8252-251be6dece39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53dcbab-5940-4d03-bcf7-1de6ac7b0c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53dcbab-5940-4d03-bcf7-1de6ac7b0c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-322730883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76f7c8c-3fba-4884-88c5-18e05bf3fa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219b00b9-d5bd-460d-8cd9-13beed79e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219b00b9-d5bd-460d-8cd9-13beed79e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3f15ce-56a5-488f-a2dc-10992ae6717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3f15ce-56a5-488f-a2dc-10992ae6717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e76f7c8c-3fba-4884-88c5-18e05bf3fa97', 'volume_name': 'volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e979a2e5-c8ec-4d49-9486-e548938b90b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e979a2e5-c8ec-4d49-9486-e548938b90b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d38b0-8ee3-4fa9-a111-bc2bc57c18da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume e76f7c8c-3fba-4884-88c5-18e05bf3fa97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97', 'volume_size': 1}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-322730883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e76f7c8c-3fba-4884-88c5-18e05bf3fa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Creating volume e76f7c8c-3fba-4884-88c5-18e05bf3fa97 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (cd0659bc-2acd-452a-91f7-07bf83155c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14aa694-bcfb-4345-902b-b2e20606b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14aa694-bcfb-4345-902b-b2e20606b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394460436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da28b57-acb7-40f8-8596-0d59c8467207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209dd697-daa8-44fe-b482-a8d2f1d6b199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 1073741824
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209dd697-daa8-44fe-b482-a8d2f1d6b199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fc2675-4247-457d-b433-16d3e314b0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fc2675-4247-457d-b433-16d3e314b0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da28b57-acb7-40f8-8596-0d59c8467207', 'volume_name': 'volume-7da28b57-acb7-40f8-8596-0d59c8467207', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a356ca5-d5d8-41ec-851c-b0fa8330d88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a356ca5-d5d8-41ec-851c-b0fa8330d88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88725b97-e2ef-4a35-8ad2-8d16a085e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Volume 7da28b57-acb7-40f8-8596-0d59c8467207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da28b57-acb7-40f8-8596-0d59c8467207', 'volume_size': 1}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (52eb27f2-2fdf-427c-8e3c-7c9493841998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eeaeccf-2485-497c-81dc-df981bd83c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eeaeccf-2485-497c-81dc-df981bd83c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537398544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bb2493-6e0f-48bc-bfc8-be094a5720f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c798ed-422b-49d4-8890-9cf85dadd496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c798ed-422b-49d4-8890-9cf85dadd496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0935e876-c9ea-476c-b7d5-e000a983c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0935e876-c9ea-476c-b7d5-e000a983c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bb2493-6e0f-48bc-bfc8-be094a5720f1', 'volume_name': 'volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30dfe3f-0ab6-4cea-afe6-68736f1172b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30dfe3f-0ab6-4cea-afe6-68736f1172b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9a6f23-ec95-46ad-bddb-938543777f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Volume 40bb2493-6e0f-48bc-bfc8-be094a5720f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1', 'volume_size': 1}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (7deee56e-348d-4aac-9cf2-ad33345351e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ff5b86-0c13-4cec-b6f7-e1d29554d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ff5b86-0c13-4cec-b6f7-e1d29554d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1762548139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232fa3c4-529d-4ec3-aa3e-084c90864cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e61e21726fd4439bfd7684c18aefe49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='2aed2043b659485db66d39b6e85c8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d954d186-7cdd-40b1-b8d9-560fdd9bdf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d954d186-7cdd-40b1-b8d9-560fdd9bdf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f99990d-a8c9-4770-8034-007a1dad7777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f99990d-a8c9-4770-8034-007a1dad7777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232fa3c4-529d-4ec3-aa3e-084c90864cd6', 'volume_name': 'volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdae049-deb4-445c-b253-14367433f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdae049-deb4-445c-b253-14367433f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2d9d31-5a8c-4069-846f-1b53a9bb27b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Volume 232fa3c4-529d-4ec3-aa3e-084c90864cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6', 'volume_size': 1}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (d4f452c7-48b5-4cc2-97c9-37f6eff7a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8707bce-3a43-413b-9bdc-72d7ddadf772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8707bce-3a43-413b-9bdc-72d7ddadf772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834856274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd7319c-38dd-4bca-9763-78d608b8e225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:00Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b73d463-72d0-4bdc-8ba3-6dafb49f9dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b73d463-72d0-4bdc-8ba3-6dafb49f9dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95740933-989f-4eb6-9c65-1d572cee7d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95740933-989f-4eb6-9c65-1d572cee7d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd7319c-38dd-4bca-9763-78d608b8e225', 'volume_name': 'volume-fbd7319c-38dd-4bca-9763-78d608b8e225', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feaf2c59-4153-425e-96b9-86a23e791e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feaf2c59-4153-425e-96b9-86a23e791e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daf1f12-29db-482a-b546-678fb85d2865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Volume fbd7319c-38dd-4bca-9763-78d608b8e225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd7319c-38dd-4bca-9763-78d608b8e225', 'volume_size': 1}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (3ea8b19c-c38b-4894-837c-25cfa2627e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871fb90f-6b27-4ffa-9e32-a35fec86a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871fb90f-6b27-4ffa-9e32-a35fec86a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308980802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89de944f-5102-4b56-a428-58d219ed6114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:00Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e2b505-3a40-4ae4-8e93-e70cd2197dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e2b505-3a40-4ae4-8e93-e70cd2197dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b53288-7bd9-48ac-aafe-9c71e6586926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b53288-7bd9-48ac-aafe-9c71e6586926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89de944f-5102-4b56-a428-58d219ed6114', 'volume_name': 'volume-89de944f-5102-4b56-a428-58d219ed6114', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059452a1-dcfa-411d-8604-4be5e7d0019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059452a1-dcfa-411d-8604-4be5e7d0019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a5fbdc-7c09-4d71-8e0d-899bd60b03af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:58:59 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Volume 89de944f-5102-4b56-a428-58d219ed6114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89de944f-5102-4b56-a428-58d219ed6114', 'volume_size': 1}
Apr 06 16:58:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:00 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 1073741824" returned: 0 in 0.730s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:00 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97
Apr 06 16:59:00 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (2eb44677-5465-4dca-993a-c6af71cc19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024a7a64-98a3-4a33-919f-047480e431c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024a7a64-98a3-4a33-919f-047480e431c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1742037167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2934728-66b6-41cb-9b66-3aeef4d3aa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:00Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa875c7-93e7-4cc1-8f3b-2bd2cffab29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa875c7-93e7-4cc1-8f3b-2bd2cffab29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50873d74-b932-42bf-ba06-d08aaeb30369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50873d74-b932-42bf-ba06-d08aaeb30369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2934728-66b6-41cb-9b66-3aeef4d3aa51', 'volume_name': 'volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d534d6c3-f540-43d5-9d74-f9d513dbbd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d534d6c3-f540-43d5-9d74-f9d513dbbd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c0688d-3462-4c2b-a25a-372c858e3cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:00 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Volume d2934728-66b6-41cb-9b66-3aeef4d3aa51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51', 'volume_size': 1}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:00 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394460436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da28b57-acb7-40f8-8596-0d59c8467207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Creating volume 7da28b57-acb7-40f8-8596-0d59c8467207 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:00 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:00 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207 1073741824
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d38b0-8ee3-4fa9-a111-bc2bc57c18da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:00 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2962a6-1d7b-4c19-ab03-83f501e0be4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:00 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 (e76f7c8c-3fba-4884-88c5-18e05bf3fa97): created successfully
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b2962a6-1d7b-4c19-ab03-83f501e0be4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (d7b749ad-5ccd-466e-8252-251be6dece39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:00 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d371e771-00ef-4a71-b848-e11eeef3b402 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created volume successfully.
Apr 06 16:59:00 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:00 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207 1073741824" returned: 0 in 0.469s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:01 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207
Apr 06 16:59:01 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:01 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207" returned: 0 in 0.465s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-537398544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bb2493-6e0f-48bc-bfc8-be094a5720f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Creating volume 40bb2493-6e0f-48bc-bfc8-be094a5720f1 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:01 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88725b97-e2ef-4a35-8ad2-8d16a085e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da28b57-acb7-40f8-8596-0d59c8467207', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 1073741824
Apr 06 16:59:01 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85f284a-f717-4d0e-b290-b088f238ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Volume volume-7da28b57-acb7-40f8-8596-0d59c8467207 (7da28b57-acb7-40f8-8596-0d59c8467207): created successfully
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85f284a-f717-4d0e-b290-b088f238ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (cd0659bc-2acd-452a-91f7-07bf83155c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:01 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d1bda5b4-fd5b-4df1-84e9-8264cf7f6576 tempest-CreateVolumesFromImageTest-1841475942 None] Created volume successfully.
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (7db5e723-a43d-497f-bdde-f31257ea64ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e368897e-9e55-4340-8512-45a9ed9f0e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e368897e-9e55-4340-8512-45a9ed9f0e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1110211608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77756a10-fb1d-4350-9ed4-09f9d6e7bbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22544515-41e1-40a1-941c-9999f2427cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22544515-41e1-40a1-941c-9999f2427cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1493529-70ec-437c-972d-80b5ca029a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1493529-70ec-437c-972d-80b5ca029a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77756a10-fb1d-4350-9ed4-09f9d6e7bbe3', 'volume_name': 'volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7424e2-1180-43be-be83-400f321e9ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7424e2-1180-43be-be83-400f321e9ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0537c20f-0019-4004-81e6-3f5f3c53b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume 77756a10-fb1d-4350-9ed4-09f9d6e7bbe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3', 'volume_size': 1}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (2d33a0e8-dfc3-4ef1-a504-a61ac3fb8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e4e762-ba44-4513-a7f8-ac219c598e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e4e762-ba44-4513-a7f8-ac219c598e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084227610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbc92bd-c731-4370-99b7-34fbfa751dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca09eb11-c932-40a3-8147-9325929bd651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca09eb11-c932-40a3-8147-9325929bd651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17ceffe-4555-4e50-96f6-46b719f70b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17ceffe-4555-4e50-96f6-46b719f70b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbc92bd-c731-4370-99b7-34fbfa751dc3', 'volume_name': 'volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eb4f42-1370-4a70-ad1e-b7908a6b0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31eb4f42-1370-4a70-ad1e-b7908a6b0380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d9174-2bf6-46e2-9ef5-37550c80b71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:01 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume 0bbc92bd-c731-4370-99b7-34fbfa751dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3', 'volume_size': 1}
Apr 06 16:59:01 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:02 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (62c9e13c-1d7f-4ac8-954a-625317392660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46df2f38-90ee-4151-985a-862faed2e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 1073741824" returned: 0 in 0.707s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46df2f38-90ee-4151-985a-862faed2e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979293900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc5addf-0d4e-47e5-95df-f774f544ecb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e01c59-4ae6-4090-a238-b52cd867c4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e01c59-4ae6-4090-a238-b52cd867c4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f618651-546d-419b-9622-d3d91a59a275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f618651-546d-419b-9622-d3d91a59a275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc5addf-0d4e-47e5-95df-f774f544ecb6', 'volume_name': 'volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdb8ffe-cb8b-4f1d-9434-3896013d9d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdb8ffe-cb8b-4f1d-9434-3896013d9d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c38e5be-0177-4ac4-8dab-f33ad685446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume 4dc5addf-0d4e-47e5-95df-f774f544ecb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6', 'volume_size': 1}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:02 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1
Apr 06 16:59:02 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (c5ba6c0b-12a6-4559-9c28-a74f1a5a6009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dde96a-5b67-4e0b-8f47-a7aebfcd4a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dde96a-5b67-4e0b-8f47-a7aebfcd4a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138434145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693a71d-5b7c-4572-ac87-97c8ff76a8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4f21a0-4335-410b-bf7f-3ba58c39abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4f21a0-4335-410b-bf7f-3ba58c39abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f4ca35-86fb-40d0-a946-f45856d92eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f4ca35-86fb-40d0-a946-f45856d92eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3693a71d-5b7c-4572-ac87-97c8ff76a8a6', 'volume_name': 'volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4278d-46ac-4b05-92f7-c269936477dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4278d-46ac-4b05-92f7-c269936477dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eda20ca-cca3-41be-a43e-fd1fb4642afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume 3693a71d-5b7c-4572-ac87-97c8ff76a8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6', 'volume_size': 1}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (d47984c9-69e6-4f73-a0e8-38496e703171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f364b0-fb7f-4c6e-8100-24d5bdacb5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f364b0-fb7f-4c6e-8100-24d5bdacb5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442851259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cd8419-3599-4455-9ea0-1740be5adef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:03Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83415346-9d7d-4a04-8caa-4a0a82be9cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83415346-9d7d-4a04-8caa-4a0a82be9cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12468118-21eb-4df3-a5de-96c6d2fa5300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12468118-21eb-4df3-a5de-96c6d2fa5300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cd8419-3599-4455-9ea0-1740be5adef3', 'volume_name': 'volume-d4cd8419-3599-4455-9ea0-1740be5adef3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf39d74-5dc5-4949-8b29-f8daa04d3f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf39d74-5dc5-4949-8b29-f8daa04d3f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de81447b-ea80-4a03-878d-ac9baf445b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume d4cd8419-3599-4455-9ea0-1740be5adef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cd8419-3599-4455-9ea0-1740be5adef3', 'volume_size': 1}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:02 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1" returned: 0 in 0.472s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.146s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1762548139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232fa3c4-529d-4ec3-aa3e-084c90864cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e61e21726fd4439bfd7684c18aefe49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:58:59Z,use_quota=True,user_id='2aed2043b659485db66d39b6e85c8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Creating volume 232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:02 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9a6f23-ec95-46ad-bddb-938543777f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34211e8a-b080-472d-b859-28c81fa1f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:02 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 1073741824
Apr 06 16:59:02 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:02 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Volume volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 (40bb2493-6e0f-48bc-bfc8-be094a5720f1): created successfully
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34211e8a-b080-472d-b859-28c81fa1f156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:02 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (52eb27f2-2fdf-427c-8e3c-7c9493841998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:02 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-63babd15-d76f-419f-b38b-5d001e047829 tempest-CreateVolumesFromImageTest-1841475942 None] Created volume successfully.
Apr 06 16:59:03 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 1073741824" returned: 0 in 0.496s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:03 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:03 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:03 devstack sudo[90500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:03 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:03 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.009s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-834856274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd7319c-38dd-4bca-9763-78d608b8e225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:00Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Creating volume fbd7319c-38dd-4bca-9763-78d608b8e225 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:03 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2d9d31-5a8c-4069-846f-1b53a9bb27b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82385c1-6ed5-492d-95cb-823e6f336b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:03 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225 1073741824
Apr 06 16:59:03 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:03 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Volume volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 (232fa3c4-529d-4ec3-aa3e-084c90864cd6): created successfully
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82385c1-6ed5-492d-95cb-823e6f336b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:03 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (7deee56e-348d-4aac-9cf2-ad33345351e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:03 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9f6b0b12-b150-4fac-868b-ba383e02cbde tempest-VolumeDependencyTests-690672778 None] Created volume successfully.
Apr 06 16:59:04 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:04 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225 1073741824" returned: 0 in 0.573s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:04 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225
Apr 06 16:59:04 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:04 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.895s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308980802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89de944f-5102-4b56-a428-58d219ed6114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:00Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Creating volume 89de944f-5102-4b56-a428-58d219ed6114 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:04 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daf1f12-29db-482a-b546-678fb85d2865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd7319c-38dd-4bca-9763-78d608b8e225', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306e6536-1262-4ffb-8f66-0ef79bd20415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:04 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114 1073741824
Apr 06 16:59:04 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:04 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Volume volume-fbd7319c-38dd-4bca-9763-78d608b8e225 (fbd7319c-38dd-4bca-9763-78d608b8e225): created successfully
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306e6536-1262-4ffb-8f66-0ef79bd20415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (d4f452c7-48b5-4cc2-97c9-37f6eff7a445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:04 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-416700ba-c6cd-46e4-9971-62d4cdc12c57 tempest-CreateVolumesFromImageTest-1841475942 None] Created volume successfully.
Apr 06 16:59:05 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114 1073741824" returned: 0 in 0.531s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:05 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114
Apr 06 16:59:05 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:05 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.630s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1742037167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2934728-66b6-41cb-9b66-3aeef4d3aa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7274bbc18e0645d6b33ce7c4d9b107fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:00Z,use_quota=True,user_id='e3ca1f0aade44fdd93401780ee741131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Creating volume d2934728-66b6-41cb-9b66-3aeef4d3aa51 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:05 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:05 devstack sudo[90520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 1073741824
Apr 06 16:59:05 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a5fbdc-7c09-4d71-8e0d-899bd60b03af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89de944f-5102-4b56-a428-58d219ed6114', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb3b767-aa23-4187-bea5-f4510e949ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:05 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Volume volume-89de944f-5102-4b56-a428-58d219ed6114 (89de944f-5102-4b56-a428-58d219ed6114): created successfully
Apr 06 16:59:05 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb3b767-aa23-4187-bea5-f4510e949ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (3ea8b19c-c38b-4894-837c-25cfa2627e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:06 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3080271f-2a6a-483c-9573-e4550375d325 tempest-CreateVolumesFromImageTest-1841475942 None] Created volume successfully.
Apr 06 16:59:06 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 1073741824" returned: 0 in 0.570s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:06 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51
Apr 06 16:59:06 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:06 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.220s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1110211608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77756a10-fb1d-4350-9ed4-09f9d6e7bbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Creating volume 77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:06 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c0688d-3462-4c2b-a25a-372c858e3cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:06 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 1073741824
Apr 06 16:59:06 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:06 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fac3c9-6daf-4ed0-9b79-4f4cd7db3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:07 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Volume volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 (d2934728-66b6-41cb-9b66-3aeef4d3aa51): created successfully
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fac3c9-6daf-4ed0-9b79-4f4cd7db3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Flow 'volume_create_manager' (2eb44677-5465-4dca-993a-c6af71cc19a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:07 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-33463c42-29c2-491c-b06e-0a44434f83eb tempest-CreateVolumesFromImageTest-1841475942 None] Created volume successfully.
Apr 06 16:59:07 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 1073741824" returned: 0 in 0.521s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:07 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3
Apr 06 16:59:07 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-d2934728-66b6-41cb-9b66-3aeef4d3aa51-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-d2934728-66b6-41cb-9b66-3aeef4d3aa51-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-quobyte-d2934728-66b6-41cb-9b66-3aeef4d3aa51" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-d2934728-66b6-41cb-9b66-3aeef4d3aa51" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d07109-3454-4297-a94b-d603c2a91b52]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:07 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:07 devstack sudo[90536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51
Apr 06 16:59:07 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.067s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084227610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbc92bd-c731-4370-99b7-34fbfa751dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Creating volume 0bbc92bd-c731-4370-99b7-34fbfa751dc3 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:07 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:07 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0537c20f-0019-4004-81e6-3f5f3c53b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b52654a-9ffa-491f-b33a-c239d8214e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:08 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 1073741824
Apr 06 16:59:08 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:08 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 (77756a10-fb1d-4350-9ed4-09f9d6e7bbe3): created successfully
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b52654a-9ffa-491f-b33a-c239d8214e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (7db5e723-a43d-497f-bdde-f31257ea64ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:08 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-863cf4f0-ecda-4b73-afac-7a3d1d22ecb1 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created volume successfully.
Apr 06 16:59:08 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51" returned: 0 in 0.559s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:08 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51
Apr 06 16:59:08 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:08 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 1073741824" returned: 0 in 0.520s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:08 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3
Apr 06 16:59:08 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:08 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d2934728-66b6-41cb-9b66-3aeef4d3aa51" returned: 0 in 0.421s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-d2934728-66b6-41cb-9b66-3aeef4d3aa51" released by "delete_volume" :: held 1.011s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Created reservations ['1314a28e-a2df-4b0f-ba04-f91b60420654', '8bc3b181-938c-4e20-ac1e-53b5034f8f34', 'fb25ca5c-715a-4d9c-9e7c-cfd752a740b8', 'ebe6b9b9-ab9d-4825-a79d-dd74b4586c01'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:08 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3" returned: 0 in 0.455s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:08 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:08 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.706s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:08 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979293900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc5addf-0d4e-47e5-95df-f774f544ecb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Creating volume 4dc5addf-0d4e-47e5-95df-f774f544ecb6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:09 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355d9174-2bf6-46e2-9ef5-37550c80b71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7812f937-f51c-4262-b60e-cb461009e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:09 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 1073741824
Apr 06 16:59:09 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:09 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 (0bbc92bd-c731-4370-99b7-34fbfa751dc3): created successfully
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7812f937-f51c-4262-b60e-cb461009e17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (2d33a0e8-dfc3-4ef1-a504-a61ac3fb8591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:09 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f8c37271-381a-4896-a11f-e3315aa32c25 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created volume successfully.
Apr 06 16:59:09 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:09 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Deleted volume successfully.
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a22947ad-b54d-4ec9-b3a2-052b7b2bc1bf tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-d2934728-66b6-41cb-9b66-3aeef4d3aa51-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:09 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 1073741824" returned: 0 in 0.506s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:09 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6
Apr 06 16:59:09 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:09 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.420s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138434145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693a71d-5b7c-4572-ac87-97c8ff76a8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:02Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Creating volume 3693a71d-5b7c-4572-ac87-97c8ff76a8a6 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:09 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:10 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c38e5be-0177-4ac4-8dab-f33ad685446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ccb304-c27e-403f-9ed2-cf144ad9acac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:10 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 (4dc5addf-0d4e-47e5-95df-f774f544ecb6): created successfully
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ccb304-c27e-403f-9ed2-cf144ad9acac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:10 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 1073741824
Apr 06 16:59:10 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (62c9e13c-1d7f-4ac8-954a-625317392660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:10 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ba58a3cd-35ac-4236-8e66-c7d7c5f8b08b tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created volume successfully.
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-89de944f-5102-4b56-a428-58d219ed6114-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-89de944f-5102-4b56-a428-58d219ed6114-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-quobyte-89de944f-5102-4b56-a428-58d219ed6114" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-89de944f-5102-4b56-a428-58d219ed6114" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[e684ee00-2817-45a0-82f5-d99f52ad5d91]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:10 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114
Apr 06 16:59:10 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:10 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 1073741824" returned: 0 in 0.568s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:10 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6
Apr 06 16:59:10 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:10 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:10 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:10 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114
Apr 06 16:59:10 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:11 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6" returned: 0 in 0.449s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.377s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1442851259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cd8419-3599-4455-9ea0-1740be5adef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0d583d49d04ebe849274b3a84f5776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:03Z,use_quota=True,user_id='54dadc4c0e3846059edcd2974b7f4c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Creating volume d4cd8419-3599-4455-9ea0-1740be5adef3 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:11 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eda20ca-cca3-41be-a43e-fd1fb4642afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51fd8fa-917a-4b1b-be7b-0fb51f2b0d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:11 devstack sudo[90579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3 1073741824
Apr 06 16:59:11 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:11 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 (3693a71d-5b7c-4572-ac87-97c8ff76a8a6): created successfully
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51fd8fa-917a-4b1b-be7b-0fb51f2b0d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (c5ba6c0b-12a6-4559-9c28-a74f1a5a6009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:11 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-48cf5faf-9dc9-4996-b10b-a98421192547 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created volume successfully.
Apr 06 16:59:11 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-89de944f-5102-4b56-a428-58d219ed6114" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-89de944f-5102-4b56-a428-58d219ed6114" released by "delete_volume" :: held 1.071s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Created reservations ['b4569d39-a1b2-4260-b77e-82c5d1533dcc', 'fa7003af-3b3c-4ddf-b204-729cd82a5951', '4ea69a23-96e9-49fc-b988-584b3771b940', 'c2323939-9d5b-4a60-838f-8daab0458779'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:11 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:11 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:11 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3 1073741824" returned: 0 in 0.680s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:11 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3
Apr 06 16:59:11 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:11 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.507s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:11 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Deleted volume successfully.
Apr 06 16:59:11 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f76f58d1-e95e-4b7d-8bda-61a3ca3e557f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-89de944f-5102-4b56-a428-58d219ed6114-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:12 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3" returned: 0 in 0.475s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.301s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de81447b-ea80-4a03-878d-ac9baf445b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cd8419-3599-4455-9ea0-1740be5adef3', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc19fe5-1945-490a-b366-866fcdc82f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Creating offline snapshot 152825a9-a4f7-40ef-a8b3-a8335dc088ad of volume 232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:59:12 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Volume volume-d4cd8419-3599-4455-9ea0-1740be5adef3 (d4cd8419-3599-4455-9ea0-1740be5adef3): created successfully
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc19fe5-1945-490a-b366-866fcdc82f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Flow 'volume_create_manager' (d47984c9-69e6-4f73-a0e8-38496e703171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebea1aa-3d3c-4c62-8806-67861bc48b89]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-fbd7319c-38dd-4bca-9763-78d608b8e225-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:12 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-3f7a6c20-2e92-4cc9-be46-4b6ab57c2dc4 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created volume successfully.
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-fbd7319c-38dd-4bca-9763-78d608b8e225-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-quobyte-fbd7319c-38dd-4bca-9763-78d608b8e225" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-fbd7319c-38dd-4bca-9763-78d608b8e225" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc253668-1783-4782-978e-77eded12bf58]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:12 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:12 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:12 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225
Apr 06 16:59:12 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:12 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.531s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:12 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad 1G
Apr 06 16:59:12 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:12 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225" returned: 0 in 0.535s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:12 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:12 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225
Apr 06 16:59:12 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:13 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad 1G" returned: 0 in 0.520s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:13 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad
Apr 06 16:59:13 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-d4cd8419-3599-4455-9ea0-1740be5adef3-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-d4cd8419-3599-4455-9ea0-1740be5adef3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-quobyte-d4cd8419-3599-4455-9ea0-1740be5adef3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:13 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-fbd7319c-38dd-4bca-9763-78d608b8e225" returned: 0 in 0.557s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-d4cd8419-3599-4455-9ea0-1740be5adef3" acquired by "delete_volume" :: waited 0.020s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-fbd7319c-38dd-4bca-9763-78d608b8e225" released by "delete_volume" :: held 1.128s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d196fa18-42dc-4afe-be40-a56bf5508178]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Created reservations ['43addf9d-dbe5-4e04-a790-50586ad9f8f7', '10e7f547-84a0-4694-bda4-a7c85340df4b', '4434973e-3f8c-418b-bf07-778497a06a46', 'db6d2f19-3e1f-4ced-b4d6-8931c310060c'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:13 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3
Apr 06 16:59:13 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:13 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:13 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:13 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad" returned: 0 in 0.512s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:13 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad is being set with open permissions: ugo+rw
Apr 06 16:59:13 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:13 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad
Apr 06 16:59:13 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:14 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.445s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:14 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Deleted volume successfully.
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-e923848d-0bd7-4d47-ad0c-13bcd86a869b tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-fbd7319c-38dd-4bca-9763-78d608b8e225-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:14 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3" returned: 0 in 0.592s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:14 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3
Apr 06 16:59:14 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:14 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad" returned: 0 in 0.522s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:14 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info
Apr 06 16:59:14 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-40bb2493-6e0f-48bc-bfc8-be094a5720f1-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:14 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-d4cd8419-3599-4455-9ea0-1740be5adef3" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-40bb2493-6e0f-48bc-bfc8-be094a5720f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-d4cd8419-3599-4455-9ea0-1740be5adef3" released by "delete_volume" :: held 1.086s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-quobyte-40bb2493-6e0f-48bc-bfc8-be094a5720f1" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-40bb2493-6e0f-48bc-bfc8-be094a5720f1" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created reservations ['fe13239c-cfa4-43f2-a4a3-1bd15c78fc7a', 'b8fb7919-da69-4651-b283-80b3672566d7', '7d9c6af5-db75-445c-be9e-66d613c24326', '50779c6f-861d-4338-bafb-1f167b709503'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[310fd482-4f2f-4962-870c-5caa821056e9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:14 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:14 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:14 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1
Apr 06 16:59:14 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:14 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info" returned: 0 in 0.470s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:14 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info is being set with open permissions: ugo+rw
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:14 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info
Apr 06 16:59:14 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Flow 'volume_create_manager' (a40b8580-5225-4be7-8452-07c558333505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:14 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebea0e4-3247-4006-9427-64bef8a9439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebea0e4-3247-4006-9427-64bef8a9439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-934774868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380132c6-b381-422c-a057-c48e52fe4c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a05095a3d343bc96dfc27057d174aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:15Z,use_quota=True,user_id='1e981ea51185464197f1d8c0b2d31e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd537c7-6ffa-483a-a392-a14063d9dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fd537c7-6ffa-483a-a392-a14063d9dd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ce8f05-8c9e-4d35-b704-db377805f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ce8f05-8c9e-4d35-b704-db377805f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380132c6-b381-422c-a057-c48e52fe4c42', 'volume_name': 'volume-380132c6-b381-422c-a057-c48e52fe4c42', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f45822e-9355-43d8-81bd-3f05cd3efc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f45822e-9355-43d8-81bd-3f05cd3efc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19da8443-4f6c-4cec-80aa-8f54ed89b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:15 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Volume 380132c6-b381-422c-a057-c48e52fe4c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380132c6-b381-422c-a057-c48e52fe4c42', 'volume_size': 1}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:15 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Deleted volume successfully.
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7d3a09ac-6e7f-438a-bf60-e9ce2495eb81 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-d4cd8419-3599-4455-9ea0-1740be5adef3-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:15 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1" returned: 0 in 0.551s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:15 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1
Apr 06 16:59:15 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:15 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.info" returned: 0 in 0.403s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-934774868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380132c6-b381-422c-a057-c48e52fe4c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a05095a3d343bc96dfc27057d174aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:15Z,use_quota=True,user_id='1e981ea51185464197f1d8c0b2d31e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Creating volume 380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:15 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:15 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a34d54f3-277a-4dcd-b04f-e966e7c1aebb tempest-VolumeDependencyTests-690672778 None] Create snapshot completed successfully
Apr 06 16:59:15 devstack sudo[90651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 1073741824
Apr 06 16:59:15 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:15 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-40bb2493-6e0f-48bc-bfc8-be094a5720f1" returned: 0 in 0.416s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-40bb2493-6e0f-48bc-bfc8-be094a5720f1" released by "delete_volume" :: held 1.006s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Created reservations ['76ecee33-5aab-41fa-8e10-669cf08ebf36', '6b9a4c7b-67cf-49f8-bf72-4a4bb3332b4a', '1bd2f048-e307-45fe-b7db-ccded5f60c55', '682ecf8b-2f8c-4043-9f95-e68fac80d643'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-3693a71d-5b7c-4572-ac87-97c8ff76a8a6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-3693a71d-5b7c-4572-ac87-97c8ff76a8a6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:15 devstack sudo[90657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:15 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-quobyte-3693a71d-5b7c-4572-ac87-97c8ff76a8a6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-3693a71d-5b7c-4572-ac87-97c8ff76a8a6" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52d6e9-5aa2-4077-9419-9e19dec310d3]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:15 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 1073741824" returned: 0 in 0.534s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:15 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6
Apr 06 16:59:15 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:15 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:15 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:15 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:16 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.412s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:16 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Deleted volume successfully.
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f14b712a-2d66-4cf3-9f8c-349da01fb0f4 tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-40bb2493-6e0f-48bc-bfc8-be094a5720f1-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:16 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:16 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6
Apr 06 16:59:16 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:16 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.440s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19da8443-4f6c-4cec-80aa-8f54ed89b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380132c6-b381-422c-a057-c48e52fe4c42', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70da5f74-a285-42f5-be47-cbae3d66fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:16 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Volume volume-380132c6-b381-422c-a057-c48e52fe4c42 (380132c6-b381-422c-a057-c48e52fe4c42): created successfully
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70da5f74-a285-42f5-be47-cbae3d66fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Flow 'volume_create_manager' (a40b8580-5225-4be7-8452-07c558333505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:16 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ee0490c7-e356-4ced-ae96-fe336c97a137 tempest-SnapshotDependencyTests-285792625 None] Created volume successfully.
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (4936b205-8822-4772-88bf-33cfeefd97b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41f924c-0a04-476e-957d-7228fa2ca619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41f924c-0a04-476e-957d-7228fa2ca619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1764103936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e61e21726fd4439bfd7684c18aefe49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=152825a9-a4f7-40ef-a8b3-a8335dc088ad,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:17Z,use_quota=True,user_id='2aed2043b659485db66d39b6e85c8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2ea5c1-7690-400c-b2ac-59bc28c212e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2ea5c1-7690-400c-b2ac-59bc28c212e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa25802-317f-4792-97d8-fe13b501e195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa25802-317f-4792-97d8-fe13b501e195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24', 'volume_name': 'volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24', 'volume_size': 1, 'snapshot_id': '152825a9-a4f7-40ef-a8b3-a8335dc088ad'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e98f57-63fd-49cf-994a-076899ca65cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e98f57-63fd-49cf-994a-076899ca65cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889042af-4e58-49f8-a18b-d8a00151f9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:16 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Volume 2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24', 'volume_size': 1, 'snapshot_id': '152825a9-a4f7-40ef-a8b3-a8335dc088ad'}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-152825a9-a4f7-40ef-a8b3-a8335dc088ad-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-152825a9-a4f7-40ef-a8b3-a8335dc088ad-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Creating volume 2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 from snapshot 152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] snapshot: 152825a9-a4f7-40ef-a8b3-a8335dc088ad, volume: 2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e1ab96-bdd4-4e75-9f44-38221db77a17]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:16 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-3693a71d-5b7c-4572-ac87-97c8ff76a8a6" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-7da28b57-acb7-40f8-8596-0d59c8467207-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-3693a71d-5b7c-4572-ac87-97c8ff76a8a6" released by "delete_volume" :: held 0.995s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-7da28b57-acb7-40f8-8596-0d59c8467207-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "cinder-quobyte-7da28b57-acb7-40f8-8596-0d59c8467207" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:16 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad
Apr 06 16:59:16 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-7da28b57-acb7-40f8-8596-0d59c8467207" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created reservations ['8a36be9f-b7ff-4856-95ca-41c40db01710', '594b85f9-1fc3-44d3-b76b-0ea17cbaba2b', '1f6df69e-0ab1-4742-8f84-b5abc600a5f5', '2ac4b796-5517-4ae7-a0c3-8c037ba952b5'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b07f08-4b04-441e-b8a0-d5d07dbde0f1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:16 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:16 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:16 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:16 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207
Apr 06 16:59:16 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:17 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad" returned: 0 in 0.515s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7da4a2-b389-4162-a9b1-ce871c617ec4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:17 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:17 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:17 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207" returned: 0 in 0.522s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:17 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.482s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:17 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Deleted volume successfully.
Apr 06 16:59:17 devstack sudo[90686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207
Apr 06 16:59:17 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-5c1b5ac5-d7f3-4170-bfa2-b9dd28d9c347 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-3693a71d-5b7c-4572-ac87-97c8ff76a8a6-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:17 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.470s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:17 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24
Apr 06 16:59:17 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:17 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-7da28b57-acb7-40f8-8596-0d59c8467207" returned: 0 in 0.398s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-quobyte-7da28b57-acb7-40f8-8596-0d59c8467207" released by "delete_volume" :: held 0.945s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Created reservations ['0995d4c0-3e02-49ca-b70d-5a5183fb7da6', '8dc9553a-b08a-4af9-bf1d-c0178a9fef4b', 'ffa5d252-6351-45b3-a80c-61df1846eee5', '114d9330-58c4-455e-853c-6e9a773731a2'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:17 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:17 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:17 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-4dc5addf-0d4e-47e5-95df-f774f544ecb6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-4dc5addf-0d4e-47e5-95df-f774f544ecb6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-quobyte-4dc5addf-0d4e-47e5-95df-f774f544ecb6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-4dc5addf-0d4e-47e5-95df-f774f544ecb6" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b441a46f-82e4-42d0-9fd5-7e95f62e167e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:18 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6
Apr 06 16:59:18 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:18 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.606s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:18 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Deleted volume successfully.
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-8f9491cc-e028-48aa-9b8e-959d10dab01f tempest-CreateVolumesFromImageTest-1841475942 None] Lock "cinder-7da28b57-acb7-40f8-8596-0d59c8467207-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:18 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6" returned: 0 in 0.803s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:18 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:18 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6
Apr 06 16:59:18 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:20 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-4dc5addf-0d4e-47e5-95df-f774f544ecb6" returned: 0 in 1.215s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-4dc5addf-0d4e-47e5-95df-f774f544ecb6" released by "delete_volume" :: held 2.056s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created reservations ['1587b37b-cd9c-4c1a-b73d-d8ee08022c0c', '4d289b74-03fe-42da-acc2-2a72f3a56595', 'ee7b5add-efae-4eb7-9a52-57efb9a7dd90', '17a56769-0e78-4178-93e4-e0053c6e4cf7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:20 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" returned: 0 in 2.575s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[927a4080-f70b-4e1c-8b8f-d7f706440f92]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:20 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:20 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:20 devstack sudo[90751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:20 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:20 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.499s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:20 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Deleted volume successfully.
Apr 06 16:59:20 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-62280eb1-578d-4af2-8b34-d1c87273e00a tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-4dc5addf-0d4e-47e5-95df-f774f544ecb6-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:21 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.693s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:59:21 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Converted 1024.00 MB image at 397.27 MB/s
Apr 06 16:59:21 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 is being set with open permissions: ugo+rw
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:21 devstack sudo[90760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24
Apr 06 16:59:21 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-0bbc92bd-c731-4370-99b7-34fbfa751dc3-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-0bbc92bd-c731-4370-99b7-34fbfa751dc3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-quobyte-0bbc92bd-c731-4370-99b7-34fbfa751dc3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-0bbc92bd-c731-4370-99b7-34fbfa751dc3" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c752ab9-905c-4cfe-aad2-6bbc284e5e81]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:21 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" returned: 0 in 0.429s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" released by "_copy_volume_from_snapshot" :: held 4.764s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-152825a9-a4f7-40ef-a8b3-a8335dc088ad-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" released by "_create_volume_from_snapshot" :: held 4.782s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.792s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.213s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Creating offline snapshot 97c1f258-16a5-49a7-bb4c-7f1fe805c46d of volume 380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889042af-4e58-49f8-a18b-d8a00151f9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24', 'volume_size': 1, 'snapshot_id': '152825a9-a4f7-40ef-a8b3-a8335dc088ad'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a92d3a-1957-4d6d-ae94-bd204b2e4524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[7399c48b-595b-45fd-bdc9-c9ee14f0b990]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:21 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3
Apr 06 16:59:21 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:21 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Volume volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 (2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24): created successfully
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a92d3a-1957-4d6d-ae94-bd204b2e4524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (4936b205-8822-4772-88bf-33cfeefd97b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:21 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-59454a61-11a6-4d92-a7f4-4360bf2e20a9 tempest-VolumeDependencyTests-690672778 None] Created volume successfully.
Apr 06 16:59:21 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:21 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (836e505a-d859-4bed-933b-0ac474b6c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901a2d7e-4f0c-40f8-9b73-d3de63d61245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901a2d7e-4f0c-40f8-9b73-d3de63d61245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141414336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b52c7c4-937d-45d6-ae44-46eaa5115d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:22Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a086977-3521-4894-9980-9031f7368bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a086977-3521-4894-9980-9031f7368bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb2cc3b-ef0e-4d21-a310-ac1b3418f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb2cc3b-ef0e-4d21-a310-ac1b3418f240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b52c7c4-937d-45d6-ae44-46eaa5115d50', 'volume_name': 'volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51190ab-3d7f-4e3e-b1c8-528be4f695a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51190ab-3d7f-4e3e-b1c8-528be4f695a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68470833-4749-4881-80b3-4c6e7b92768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:21 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume 0b52c7c4-937d-45d6-ae44-46eaa5115d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50', 'volume_size': 1}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:21 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3" returned: 0 in 0.481s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:21 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:21 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3
Apr 06 16:59:21 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:21 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:22 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d 1G
Apr 06 16:59:22 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-152825a9-a4f7-40ef-a8b3-a8335dc088ad-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-152825a9-a4f7-40ef-a8b3-a8335dc088ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-232fa3c4-529d-4ec3-aa3e-084c90864cd6" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-232fa3c4-529d-4ec3-aa3e-084c90864cd6" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-152825a9-a4f7-40ef-a8b3-a8335dc088ad" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-152825a9-a4f7-40ef-a8b3-a8335dc088ad" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Deleting offline snapshot 152825a9-a4f7-40ef-a8b3-a8335dc088ad of volume 232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] snapshot_file for this snap is: volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[675149d3-112a-4f12-a24d-95bd82197b54]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:22 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad
Apr 06 16:59:22 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:22 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0bbc92bd-c731-4370-99b7-34fbfa751dc3" returned: 0 in 0.464s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-0bbc92bd-c731-4370-99b7-34fbfa751dc3" released by "delete_volume" :: held 0.968s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:22 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d 1G" returned: 0 in 0.446s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380132c6-b381-422c-a057-c48e52fe4c42 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:22 devstack sudo[90783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380132c6-b381-422c-a057-c48e52fe4c42 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d
Apr 06 16:59:22 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created reservations ['c43284d9-43f6-4428-bdc9-93bc5d481222', 'c345b075-5186-4ed9-b4bc-d830d59b9e97', '96d554b5-0e64-44ed-a2ae-a3a0bf117a5f', 'c21af996-d423-40b1-b94d-476fd23bf2ea'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:22 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:22 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:22 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[882efce3-64c5-4578-977d-ff24fd0b904a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:22 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:22 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:22 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380132c6-b381-422c-a057-c48e52fe4c42 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:22 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d is being set with open permissions: ugo+rw
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:22 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.421s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:22 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Deleted volume successfully.
Apr 06 16:59:22 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d
Apr 06 16:59:22 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:22 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d05d0ec2-c811-4b7e-b166-e206aeebcfec tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-0bbc92bd-c731-4370-99b7-34fbfa751dc3-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:23 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.474s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:23 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad
Apr 06 16:59:23 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:23 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d" returned: 0 in 0.403s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:23 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info
Apr 06 16:59:23 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-quobyte-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f09775-2f74-4d62-b2a3-3399ed135b12]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:23 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:23 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad
Apr 06 16:59:23 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:23 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3
Apr 06 16:59:23 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:23 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info" returned: 0 in 0.456s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:23 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info is being set with open permissions: ugo+rw
Apr 06 16:59:23 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:23 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info
Apr 06 16:59:23 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6.152825a9-a4f7-40ef-a8b3-a8335dc088ad" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=135,cinder:UPDATE=197,cinder:DELETE=25,cinder:INSERT=44 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=129,cinder:INSERT=41,cinder:UPDATE=171,cinder:DELETE=10 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-152825a9-a4f7-40ef-a8b3-a8335dc088ad" released by "_delete_snapshot" :: held 1.902s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-232fa3c4-529d-4ec3-aa3e-084c90864cd6" released by "delete_snapshot" :: held 1.920s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:24 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3" returned: 0 in 0.458s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3
Apr 06 16:59:24 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Created reservations ['db6783b4-a7dc-4f69-aeeb-943ed8939381', 'fdfeb4db-6939-46f4-87c0-cd61d7986e86', '3a9589d6-ff05-4621-90a4-ef6a1fd16777', '4326847d-4068-4719-8923-739c7ee08336'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Delete snapshot completed successfully.
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d67fdc7a-50c6-49b2-97c3-bfb03b8536e9 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-152825a9-a4f7-40ef-a8b3-a8335dc088ad-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:24 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.info" returned: 0 in 0.410s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141414336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b52c7c4-937d-45d6-ae44-46eaa5115d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:22Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating volume 0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:24 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-232fa3c4-529d-4ec3-aa3e-084c90864cd6-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:24 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 1073741824
Apr 06 16:59:24 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-ed28638b-22cf-412c-be40-f5c7d58e5a20 tempest-SnapshotDependencyTests-285792625 None] Create snapshot completed successfully
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-232fa3c4-529d-4ec3-aa3e-084c90864cd6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-232fa3c4-529d-4ec3-aa3e-084c90864cd6" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-232fa3c4-529d-4ec3-aa3e-084c90864cd6" acquired by "delete_volume" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[50228190-87be-49f6-9189-64fb5c7e32ba]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack sudo[90826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:24 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3" released by "delete_volume" :: held 0.906s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created reservations ['6c633592-ef5f-443c-9bd6-25bd859d05c7', '1dc33a3c-ad52-4bf1-8049-91b8dc5fcff7', 'f92c0e31-8e38-409f-bd34-073c8e000a14', 'faee6ce7-729c-478b-86a0-270650416e8a'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:24 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-e76f7c8c-3fba-4884-88c5-18e05bf3fa97-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-e76f7c8c-3fba-4884-88c5-18e05bf3fa97-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "cinder-quobyte-e76f7c8c-3fba-4884-88c5-18e05bf3fa97" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-e76f7c8c-3fba-4884-88c5-18e05bf3fa97" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0844b-9db0-42de-991d-d8d771c130d9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97
Apr 06 16:59:24 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 1073741824" returned: 0 in 0.622s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:24 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.547s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6
Apr 06 16:59:24 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:24 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:24 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50
Apr 06 16:59:24 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:25 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.562s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Deleted volume successfully.
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-54ca435a-cb54-4d24-8a6a-3e0bcf64b550 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-77756a10-fb1d-4350-9ed4-09f9d6e7bbe3-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Flow 'volume_create_manager' (ed39f083-c525-4fb7-b1b8-b58641b67f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97519488-7c86-4c04-9be9-e5dc87cef143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97519488-7c86-4c04-9be9-e5dc87cef143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25905598-9e1b-4ad1-a86c-e708315e6aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a05095a3d343bc96dfc27057d174aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=97c1f258-16a5-49a7-bb4c-7f1fe805c46d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:25Z,use_quota=True,user_id='1e981ea51185464197f1d8c0b2d31e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c183f3f-0058-4630-ac34-ff0f67e4fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c183f3f-0058-4630-ac34-ff0f67e4fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb7183-ff7c-4bb7-ac14-bb1891befdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb7183-ff7c-4bb7-ac14-bb1891befdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25905598-9e1b-4ad1-a86c-e708315e6aac', 'volume_name': 'volume-25905598-9e1b-4ad1-a86c-e708315e6aac', 'volume_size': 1, 'snapshot_id': '97c1f258-16a5-49a7-bb4c-7f1fe805c46d'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e0c585-5e8b-4a6a-96f9-5498c2d15b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e0c585-5e8b-4a6a-96f9-5498c2d15b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6201b344-a131-41cf-a5da-dfa2ca5d8d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Volume 25905598-9e1b-4ad1-a86c-e708315e6aac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25905598-9e1b-4ad1-a86c-e708315e6aac', 'volume_size': 1, 'snapshot_id': '97c1f258-16a5-49a7-bb4c-7f1fe805c46d'}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:25 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97" returned: 0 in 0.590s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:25 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97
Apr 06 16:59:25 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:25 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-232fa3c4-529d-4ec3-aa3e-084c90864cd6" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-232fa3c4-529d-4ec3-aa3e-084c90864cd6" released by "delete_volume" :: held 1.106s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Created reservations ['9d9e3ea7-12e3-456f-bfb4-41b56102fe76', '3267981f-e093-4283-b1d2-d0fe56493f06', 'f8115aed-4d8c-42d8-bfe0-e3730eb0c14a', '2271ca0f-ee0b-471a-9422-c23bc23e48f7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:25 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50" returned: 0 in 0.556s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.245s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-quobyte-97c1f258-16a5-49a7-bb4c-7f1fe805c46d-25905598-9e1b-4ad1-a86c-e708315e6aac" by "_create_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68470833-4749-4881-80b3-4c6e7b92768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143c1d1f-f39b-430d-83ba-641c4bc22b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-97c1f258-16a5-49a7-bb4c-7f1fe805c46d-25905598-9e1b-4ad1-a86c-e708315e6aac" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Creating volume 25905598-9e1b-4ad1-a86c-e708315e6aac from snapshot 97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-quobyte-25905598-9e1b-4ad1-a86c-e708315e6aac" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:25 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 (0b52c7c4-937d-45d6-ae44-46eaa5115d50): created successfully
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143c1d1f-f39b-430d-83ba-641c4bc22b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (836e505a-d859-4bed-933b-0ac474b6c763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-25905598-9e1b-4ad1-a86c-e708315e6aac" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] snapshot: 97c1f258-16a5-49a7-bb4c-7f1fe805c46d, volume: 25905598-9e1b-4ad1-a86c-e708315e6aac,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:59:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-67a26e4e-01fe-402f-9b33-ed8d7c871049 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created volume successfully.
Apr 06 16:59:25 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:25 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f4263e-54a5-442d-9068-f5aad3a8caa6]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:25 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d
Apr 06 16:59:25 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:25 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e76f7c8c-3fba-4884-88c5-18e05bf3fa97" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-quobyte-e76f7c8c-3fba-4884-88c5-18e05bf3fa97" released by "delete_volume" :: held 1.051s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Created reservations ['251300ba-4389-404e-86a5-0bbc36883bb5', '5b6d3aad-6a46-4a56-8e6b-b7fb515cb9f6', '6dbf27c5-208d-4e33-9b22-abb0054ba821', '9a0359dc-505c-409c-b443-92deb66528aa'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:25 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:25 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:25 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.432s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:25 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:25 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Deleted volume successfully.
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-af40533e-59a5-436a-b9e5-4eb50b6aa517 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-232fa3c4-529d-4ec3-aa3e-084c90864cd6-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:26 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d" returned: 0 in 0.519s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-380132c6-b381-422c-a057-c48e52fe4c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8101aea9-96fa-4f43-b689-4da7206ff1c9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:26 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:26 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:26 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.443s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:26 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Deleted volume successfully.
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9bba15b4-5901-4020-964f-3d9af4749044 tempest-CreateVolumesFromSourceVolumeTest-1945557667 None] Lock "cinder-e76f7c8c-3fba-4884-88c5-18e05bf3fa97-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (f2789dc3-b315-42ad-a54d-8b39506cff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:26 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b40eea-7cde-4eff-8d4f-4af6a677acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.521s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:26 devstack sudo[90868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b40eea-7cde-4eff-8d4f-4af6a677acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-663820669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23169efa-c30a-48a8-89e0-da24c1dcd554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e61e21726fd4439bfd7684c18aefe49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:27Z,use_quota=True,user_id='2aed2043b659485db66d39b6e85c8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:26 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9cf2ce-f681-4e57-a506-ef682e7b7779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9cf2ce-f681-4e57-a506-ef682e7b7779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d17aaa-9935-4593-aa01-e44ac833dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d17aaa-9935-4593-aa01-e44ac833dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23169efa-c30a-48a8-89e0-da24c1dcd554', 'volume_name': 'volume-23169efa-c30a-48a8-89e0-da24c1dcd554', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3a4e1b-d9d3-43ab-a96b-fb55918351d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3a4e1b-d9d3-43ab-a96b-fb55918351d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afaf1cba-0ba3-4a0c-b519-c0d30bd95995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:26 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Volume 23169efa-c30a-48a8-89e0-da24c1dcd554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23169efa-c30a-48a8-89e0-da24c1dcd554', 'volume_size': 1}
Apr 06 16:59:26 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:28 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac" returned: 0 in 2.276s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:28 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[27071ceb-bff0-463f-9ec7-bcfa60946ed7]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:28 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:29 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:29 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:29 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.628s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:59:29 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Converted 1024.00 MB image at 449.79 MB/s
Apr 06 16:59:29 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac is being set with open permissions: ugo+rw
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:29 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac
Apr 06 16:59:29 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Flow 'volume_create_manager' (4c494d77-c106-4889-972e-5461461e2886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b29f5b-6e7a-4436-b7c5-65ec2df7cb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b29f5b-6e7a-4436-b7c5-65ec2df7cb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce5ee89-5995-4b2c-a82a-cb85211d00a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f072b0023d49aa99831960b2d39e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:30Z,use_quota=True,user_id='4194d1da409e480a955f3e84a781a5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e175df-c24b-493b-be43-155fb82290f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e175df-c24b-493b-be43-155fb82290f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9204d3-276d-497a-8f32-be4018ca0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9204d3-276d-497a-8f32-be4018ca0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce5ee89-5995-4b2c-a82a-cb85211d00a8', 'volume_name': 'volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4c9839-476d-4daa-8c29-38352ac5a1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4c9839-476d-4daa-8c29-38352ac5a1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c23c604-4a63-42aa-9548-c10bf9445028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:29 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Volume dce5ee89-5995-4b2c-a82a-cb85211d00a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8', 'volume_size': 1}
Apr 06 16:59:29 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:30 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac" returned: 0 in 0.420s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-25905598-9e1b-4ad1-a86c-e708315e6aac" released by "_copy_volume_from_snapshot" :: held 4.444s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-97c1f258-16a5-49a7-bb4c-7f1fe805c46d-25905598-9e1b-4ad1-a86c-e708315e6aac" released by "_create_volume_from_snapshot" :: held 4.489s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.514s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.841s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating offline snapshot 2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc of volume 0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6201b344-a131-41cf-a5da-dfa2ca5d8d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25905598-9e1b-4ad1-a86c-e708315e6aac', 'volume_size': 1, 'snapshot_id': '97c1f258-16a5-49a7-bb4c-7f1fe805c46d'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac54a67-a143-4ee4-b573-0e1d8b83223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057194f-03e6-4e7a-a897-59779f18f7a4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:30 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Volume volume-25905598-9e1b-4ad1-a86c-e708315e6aac (25905598-9e1b-4ad1-a86c-e708315e6aac): created successfully
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac54a67-a143-4ee4-b573-0e1d8b83223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Flow 'volume_create_manager' (ed39f083-c525-4fb7-b1b8-b58641b67f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:30 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-d2b36462-4c02-4508-b37a-ecd8f07fd30e tempest-SnapshotDependencyTests-285792625 None] Created volume successfully.
Apr 06 16:59:30 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50
Apr 06 16:59:30 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:30 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50" returned: 0 in 0.451s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:30 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc 1G
Apr 06 16:59:30 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-97c1f258-16a5-49a7-bb4c-7f1fe805c46d-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-97c1f258-16a5-49a7-bb4c-7f1fe805c46d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-quobyte-380132c6-b381-422c-a057-c48e52fe4c42" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-380132c6-b381-422c-a057-c48e52fe4c42" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-quobyte-97c1f258-16a5-49a7-bb4c-7f1fe805c46d" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-97c1f258-16a5-49a7-bb4c-7f1fe805c46d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Deleting offline snapshot 97c1f258-16a5-49a7-bb4c-7f1fe805c46d of volume 380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] snapshot_file for this snap is: volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b943859c-0704-4425-9ff6-03c0020347a9]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:30 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d
Apr 06 16:59:30 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:30 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc 1G" returned: 0 in 0.460s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:30 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:30 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc
Apr 06 16:59:30 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:31 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d" returned: 0 in 0.492s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-380132c6-b381-422c-a057-c48e52fe4c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7d6604-0e87-42cc-8cf6-5b9155906239]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:31 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:31 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:31 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" returned: 0 in 0.397s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:31 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc is being set with open permissions: ugo+rw
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:31 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc
Apr 06 16:59:31 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:31 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.458s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:31 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d
Apr 06 16:59:31 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:31 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" returned: 0 in 0.403s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:31 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:31 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info
Apr 06 16:59:31 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:32 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d" returned: 0 in 0.442s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:32 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d
Apr 06 16:59:32 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:32 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info" returned: 0 in 0.410s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:32 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info is being set with open permissions: ugo+rw
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:32 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info
Apr 06 16:59:32 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:32 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42.97c1f258-16a5-49a7-bb4c-7f1fe805c46d" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-97c1f258-16a5-49a7-bb4c-7f1fe805c46d" released by "_delete_snapshot" :: held 1.840s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-380132c6-b381-422c-a057-c48e52fe4c42" released by "delete_snapshot" :: held 1.854s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Created reservations ['e85fa238-dac1-4354-932e-3134ff2a2fdc', '2169efb3-0d4f-46ba-87f6-b10e419636d9', '210626f7-9c79-42b5-b2ac-9748745c4f77', '670bd887-2535-4588-8407-6cd15a10e270'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:32 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Delete snapshot completed successfully.
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-4f1f52b7-4d37-4c83-93b2-000d19e37dcc tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-97c1f258-16a5-49a7-bb4c-7f1fe805c46d-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:32 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.info" returned: 0 in 0.383s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.877s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-663820669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23169efa-c30a-48a8-89e0-da24c1dcd554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e61e21726fd4439bfd7684c18aefe49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:27Z,use_quota=True,user_id='2aed2043b659485db66d39b6e85c8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Creating volume 23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:32 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:32 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 1073741824
Apr 06 16:59:32 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:32 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a63f0572-a4ce-401c-86e1-a562e8f21bdc tempest-CreateVolumesFromSnapshotTest-653775171 None] Create snapshot completed successfully
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-380132c6-b381-422c-a057-c48e52fe4c42-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-380132c6-b381-422c-a057-c48e52fe4c42-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-quobyte-380132c6-b381-422c-a057-c48e52fe4c42" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-380132c6-b381-422c-a057-c48e52fe4c42" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2c965-f8d1-4ed3-8b0a-93b3b186b587]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:32 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:32 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:32 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:33 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 1073741824" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:33 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:33 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:33 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.484s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:33 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42
Apr 06 16:59:33 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:33 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.407s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.768s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce5ee89-5995-4b2c-a82a-cb85211d00a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f072b0023d49aa99831960b2d39e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:30Z,use_quota=True,user_id='4194d1da409e480a955f3e84a781a5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Creating volume dce5ee89-5995-4b2c-a82a-cb85211d00a8 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:33 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afaf1cba-0ba3-4a0c-b519-c0d30bd95995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23169efa-c30a-48a8-89e0-da24c1dcd554', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18393d80-8353-41fd-8fe2-62fcd3f21310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:33 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 1073741824
Apr 06 16:59:33 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Volume volume-23169efa-c30a-48a8-89e0-da24c1dcd554 (23169efa-c30a-48a8-89e0-da24c1dcd554): created successfully
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18393d80-8353-41fd-8fe2-62fcd3f21310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (f2789dc3-b315-42ad-a54d-8b39506cff1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:33 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f867d08e-5a86-4866-82ed-47a5d34902a4 tempest-VolumeDependencyTests-690672778 None] Created volume successfully.
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (f25a38b1-81c7-4e5b-92a1-2dacb77df7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43fffa8-a831-4f41-a4b8-9b8a6edee220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43fffa8-a831-4f41-a4b8-9b8a6edee220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609214578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ffde75-71ac-4779-a894-f6fcf0b85808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ffde75-71ac-4779-a894-f6fcf0b85808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794a7914-9700-492e-abf7-975ea7efe526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794a7914-9700-492e-abf7-975ea7efe526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7', 'volume_name': 'volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9de07d-79f4-4a7d-853f-ebb009c42f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9de07d-79f4-4a7d-853f-ebb009c42f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf16ba03-733d-450a-a5a2-e3804906508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:33 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume 5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7', 'volume_size': 1}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:33 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-380132c6-b381-422c-a057-c48e52fe4c42" returned: 0 in 0.461s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-380132c6-b381-422c-a057-c48e52fe4c42" released by "delete_volume" :: held 0.984s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Created reservations ['381c920d-5795-4f4b-bf6c-f0162d63f983', '8d8a2c8f-b9df-48fc-81c9-9326e4fb2658', '70e58add-0255-4584-afc1-de0b335ff0b3', '358fb5e8-afc8-4b70-b716-175e5cd374f7'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:33 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:33 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (563ae1e3-81f1-4b21-9fee-54a10814499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:33 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb5238b-6b49-41b3-975a-b1cba8d62c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb5238b-6b49-41b3-975a-b1cba8d62c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436919092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e306786b-a352-4aba-8612-7a8a8811b740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455039ee-9833-4821-9189-72f7c6dd37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455039ee-9833-4821-9189-72f7c6dd37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7999d2cf-93b6-4bf4-b306-99c6ef22148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7999d2cf-93b6-4bf4-b306-99c6ef22148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e306786b-a352-4aba-8612-7a8a8811b740', 'volume_name': 'volume-e306786b-a352-4aba-8612-7a8a8811b740', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc98b38f-5d4a-43c2-8ecd-252d80bfe315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc98b38f-5d4a-43c2-8ecd-252d80bfe315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26f213b-f0ad-4eae-bd28-2ff76f7a2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume e306786b-a352-4aba-8612-7a8a8811b740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e306786b-a352-4aba-8612-7a8a8811b740', 'volume_size': 1}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:34 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 1073741824" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:34 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8
Apr 06 16:59:34 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (80216192-43ab-401f-8e37-091bb92fc7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7c9389-8bf2-417d-a7c1-d6360a0b3abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7c9389-8bf2-417d-a7c1-d6360a0b3abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140491484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5532ccc3-26ba-49c3-b2bd-e21588182817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d3690a-ae10-43e5-8711-6078e10df6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d3690a-ae10-43e5-8711-6078e10df6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e477dadc-9c8e-4664-b493-8af4870dcb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e477dadc-9c8e-4664-b493-8af4870dcb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5532ccc3-26ba-49c3-b2bd-e21588182817', 'volume_name': 'volume-5532ccc3-26ba-49c3-b2bd-e21588182817', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3524332-efbe-47da-bc45-2b9379d0ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3524332-efbe-47da-bc45-2b9379d0ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae13fe-64c8-4e22-b8f4-1e93f0c4189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume 5532ccc3-26ba-49c3-b2bd-e21588182817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5532ccc3-26ba-49c3-b2bd-e21588182817', 'volume_size': 1}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (5c40ace0-37a9-4c95-8dcb-43003af001cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205f5557-ae7f-40ef-9a19-518ea3bc4b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205f5557-ae7f-40ef-9a19-518ea3bc4b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1336078452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce80bfeb-7db6-4508-a4d3-9163d479088c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5c9831-5e5e-4ce3-b12b-5193bda8d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5c9831-5e5e-4ce3-b12b-5193bda8d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dab376-d8ee-4a3a-a73b-2d53252dd5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dab376-d8ee-4a3a-a73b-2d53252dd5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce80bfeb-7db6-4508-a4d3-9163d479088c', 'volume_name': 'volume-ce80bfeb-7db6-4508-a4d3-9163d479088c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ca82f6-8429-47fd-b21e-df74db66b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ca82f6-8429-47fd-b21e-df74db66b13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc890203-64e3-48c6-8499-732888bf76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume ce80bfeb-7db6-4508-a4d3-9163d479088c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce80bfeb-7db6-4508-a4d3-9163d479088c', 'volume_size': 1}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.601s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Deleted volume successfully.
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-7a9e5661-e69b-482a-b96b-e5c65c1544ec tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-380132c6-b381-422c-a057-c48e52fe4c42-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (01ff983f-89b8-4620-9d48-42e4d5e04bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c085f511-a011-4c3a-854a-b552d8fdfbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c085f511-a011-4c3a-854a-b552d8fdfbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-225505545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3faf1ef-a849-4459-801f-42bcae5bf4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e61e21726fd4439bfd7684c18aefe49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=23169efa-c30a-48a8-89e0-da24c1dcd554,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:35Z,use_quota=True,user_id='2aed2043b659485db66d39b6e85c8221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46067842-c470-492e-8441-64c038eef733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46067842-c470-492e-8441-64c038eef733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851de026-3e32-49ec-987b-664740aef6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851de026-3e32-49ec-987b-664740aef6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b3faf1ef-a849-4459-801f-42bcae5bf4d1', 'volume_name': 'volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1', 'volume_size': 1, 'source_volid': '23169efa-c30a-48a8-89e0-da24c1dcd554', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba28816-b26b-475c-b55a-bab9fc0ebc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba28816-b26b-475c-b55a-bab9fc0ebc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edee34b9-0304-4069-b13a-6183932c6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Volume b3faf1ef-a849-4459-801f-42bcae5bf4d1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1', 'volume_size': 1, 'source_volid': '23169efa-c30a-48a8-89e0-da24c1dcd554', 'source_volstatus': 'available'}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (e89b6051-1e62-4e0d-8b79-96aed235b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50af1bb8-0b4d-4330-9aa9-6a5118855e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50af1bb8-0b4d-4330-9aa9-6a5118855e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361222312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e7b4e0-cee3-46c3-9c2f-c96807c9dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:35Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b29d84-73e5-4403-b7ff-78581ae5d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b29d84-73e5-4403-b7ff-78581ae5d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211b0a1b-55c8-4842-9889-d54e3b21c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211b0a1b-55c8-4842-9889-d54e3b21c32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e7b4e0-cee3-46c3-9c2f-c96807c9dc14', 'volume_name': 'volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b3bfed-477a-49a5-a238-d95c4ad699ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b3bfed-477a-49a5-a238-d95c4ad699ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9632910-d568-44ea-97e4-261c0e9de41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume 10e7b4e0-cee3-46c3-9c2f-c96807c9dc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14', 'volume_size': 1}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:34 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8" returned: 0 in 0.643s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609214578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating volume 5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c23c604-4a63-42aa-9548-c10bf9445028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 1073741824
Apr 06 16:59:34 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4b4640-2436-4851-a71b-320eb9ae99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Volume volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 (dce5ee89-5995-4b2c-a82a-cb85211d00a8): created successfully
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4b4640-2436-4851-a71b-320eb9ae99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Flow 'volume_create_manager' (4c494d77-c106-4889-972e-5461461e2886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:34 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f21557f6-d9f0-40ec-97d0-0ca54a85b7f8 tempest-CinderUnicodeTest-584790202 None] Created volume successfully.
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-25905598-9e1b-4ad1-a86c-e708315e6aac-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-25905598-9e1b-4ad1-a86c-e708315e6aac-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "cinder-quobyte-25905598-9e1b-4ad1-a86c-e708315e6aac" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:34 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-25905598-9e1b-4ad1-a86c-e708315e6aac" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33ecff9-afd6-4c0d-81c2-73d876b44ae0]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:35 devstack sudo[90960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac
Apr 06 16:59:35 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:35 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 1073741824" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:35 devstack sudo[90965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7
Apr 06 16:59:35 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.flows.manager.create_volume [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82421) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Flow 'volume_create_manager' (2f728418-af01-47af-ab4e-a698c17c97b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16757679-dd00-4897-9993-1d7cdb43a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16757679-dd00-4897-9993-1d7cdb43a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-518658388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec78dc9b-f46f-4c94-84d7-c5afe70fb62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f072b0023d49aa99831960b2d39e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:35Z,use_quota=True,user_id='4194d1da409e480a955f3e84a781a5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694a8c15-fa89-4e4d-b9c6-ffd4477c2a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694a8c15-fa89-4e4d-b9c6-ffd4477c2a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93207bf3-9256-46e1-aac7-629b1cac5b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93207bf3-9256-46e1-aac7-629b1cac5b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec78dc9b-f46f-4c94-84d7-c5afe70fb62e', 'volume_name': 'volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf6273a-8050-42eb-a8e2-a1438b4ce80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf6273a-8050-42eb-a8e2-a1438b4ce80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705a0cb2-377b-4a61-a963-6224b854f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:35 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Volume ec78dc9b-f46f-4c94-84d7-c5afe70fb62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e', 'volume_size': 1}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:35 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac" returned: 0 in 0.494s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:35 devstack sudo[90970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac
Apr 06 16:59:35 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:35 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7" returned: 0 in 0.429s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436919092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e306786b-a352-4aba-8612-7a8a8811b740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating volume e306786b-a352-4aba-8612-7a8a8811b740 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:35 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf16ba03-733d-450a-a5a2-e3804906508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dba622-135a-48d8-8e1e-a18d1eceaec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:35 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740 1073741824
Apr 06 16:59:35 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:35 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 (5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7): created successfully
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dba622-135a-48d8-8e1e-a18d1eceaec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (f25a38b1-81c7-4e5b-92a1-2dacb77df7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:35 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2354476d-76cd-423c-a914-1127770cf31e tempest-CreateVolumesFromSnapshotTest-653775171 None] Created volume successfully.
Apr 06 16:59:35 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-25905598-9e1b-4ad1-a86c-e708315e6aac" returned: 0 in 0.389s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-quobyte-25905598-9e1b-4ad1-a86c-e708315e6aac" released by "delete_volume" :: held 0.922s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Created reservations ['22336d1e-ce73-49d4-b60d-caf8deacb0fd', 'ce3d1a1b-6a37-4ee4-a737-af386b27d869', '2972a3fe-e63c-48ad-a33a-92f2c77cbde0', 'f2c16194-5617-4d3d-ae2a-592ae3cc986d'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:35 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:36 devstack sudo[90976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:36 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:36 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740 1073741824" returned: 0 in 0.499s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:36 devstack sudo[90981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740
Apr 06 16:59:36 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:36 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.459s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Deleted volume successfully.
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a5544da0-2841-4068-aee3-3448b7ffcb0d tempest-SnapshotDependencyTests-285792625 None] Lock "cinder-25905598-9e1b-4ad1-a86c-e708315e6aac-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:36 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740" returned: 0 in 0.465s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.466s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140491484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5532ccc3-26ba-49c3-b2bd-e21588182817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating volume 5532ccc3-26ba-49c3-b2bd-e21588182817 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:36 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26f213b-f0ad-4eae-bd28-2ff76f7a2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e306786b-a352-4aba-8612-7a8a8811b740', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:36 devstack sudo[90985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817 1073741824
Apr 06 16:59:36 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6e9b7f-a7c3-400c-930f-71d1d65a4d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:36 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume volume-e306786b-a352-4aba-8612-7a8a8811b740 (e306786b-a352-4aba-8612-7a8a8811b740): created successfully
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6e9b7f-a7c3-400c-930f-71d1d65a4d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:36 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (563ae1e3-81f1-4b21-9fee-54a10814499c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:36 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-54998847-3de7-4648-8d6d-54f537150577 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created volume successfully.
Apr 06 16:59:37 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817 1073741824" returned: 0 in 0.532s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:37 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817
Apr 06 16:59:37 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:37 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817" returned: 0 in 0.393s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.197s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1336078452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce80bfeb-7db6-4508-a4d3-9163d479088c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:34Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating volume ce80bfeb-7db6-4508-a4d3-9163d479088c {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:37 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ae13fe-64c8-4e22-b8f4-1e93f0c4189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5532ccc3-26ba-49c3-b2bd-e21588182817', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5286b4c7-e0d4-4b33-bd90-78721ed6c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:37 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume volume-5532ccc3-26ba-49c3-b2bd-e21588182817 (5532ccc3-26ba-49c3-b2bd-e21588182817): created successfully
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5286b4c7-e0d4-4b33-bd90-78721ed6c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:37 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c 1073741824
Apr 06 16:59:37 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:37 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (80216192-43ab-401f-8e37-091bb92fc7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:37 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a45a08f7-04c4-4b41-845d-b3db3b433eda tempest-CreateVolumesFromSnapshotTest-653775171 None] Created volume successfully.
Apr 06 16:59:38 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c 1073741824" returned: 0 in 0.588s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:38 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c
Apr 06 16:59:38 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:38 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c" returned: 0 in 0.462s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.093s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:38 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Cloning volume 23169efa-c30a-48a8-89e0-da24c1dcd554 to volume b3faf1ef-a849-4459-801f-42bcae5bf4d1
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc890203-64e3-48c6-8499-732888bf76a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce80bfeb-7db6-4508-a4d3-9163d479088c', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c55c44-968b-4bde-ab53-c874e22ed7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:38 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume volume-ce80bfeb-7db6-4508-a4d3-9163d479088c (ce80bfeb-7db6-4508-a4d3-9163d479088c): created successfully
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c55c44-968b-4bde-ab53-c874e22ed7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (5c40ace0-37a9-4c95-8dcb-43003af001cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Creating offline snapshot a68701f3-72de-42ab-a672-085e7185f215 of volume 23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:59:38 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f17b7e79-438d-46b2-8d93-02a38315d3ea tempest-CreateVolumesFromSnapshotTest-653775171 None] Created volume successfully.
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[18be7616-bde9-4635-b162-fe752358b981]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:38 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:38 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:38 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:39 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.488s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:39 devstack sudo[91010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 1G
Apr 06 16:59:39 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:39 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 1G" returned: 0 in 0.490s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:39 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23169efa-c30a-48a8-89e0-da24c1dcd554 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:39 devstack sudo[91016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23169efa-c30a-48a8-89e0-da24c1dcd554 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215
Apr 06 16:59:39 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:40 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23169efa-c30a-48a8-89e0-da24c1dcd554 -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215" returned: 0 in 0.471s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:40 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 is being set with open permissions: ugo+rw
Apr 06 16:59:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:40 devstack sudo[91021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215
Apr 06 16:59:40 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:40 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:40 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:40 devstack sudo[91024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info
Apr 06 16:59:40 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:41 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:41 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info is being set with open permissions: ugo+rw
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:41 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info
Apr 06 16:59:41 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:41 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.info" returned: 0 in 0.485s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-b3faf1ef-a849-4459-801f-42bcae5bf4d1" by "_copy_volume_from_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-b3faf1ef-a849-4459-801f-42bcae5bf4d1" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] snapshot: a68701f3-72de-42ab-a672-085e7185f215, volume: b3faf1ef-a849-4459-801f-42bcae5bf4d1,  {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b25a8-99f1-463f-a314-e10625047aab]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:41 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:41 devstack sudo[91031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215
Apr 06 16:59:41 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:42 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215" returned: 0 in 0.511s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23169efa-c30a-48a8-89e0-da24c1dcd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Creating direct copy from snapshot {{(pid=82421) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[30679efa-99ba-4a40-818b-86542475b81a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:42 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:42 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:42 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG cinder.utils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Path /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 not found in is_blk_device check {{(pid=82421) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 06 16:59:42 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:42 devstack sudo[91041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1
Apr 06 16:59:42 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:44 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1" returned: 0 in 1.954s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:44 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be74ef-af3d-4ebf-9317-f66d02903447]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:44 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:44 devstack sudo[91054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:44 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:45 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.566s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG cinder.image.image_utils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 {{(pid=82421) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 06 16:59:45 devstack cinder-volume[82421]: INFO cinder.image.image_utils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Converted 1024.00 MB image at 523.75 MB/s
Apr 06 16:59:45 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 is being set with open permissions: ugo+rw
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:45 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1
Apr 06 16:59:45 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:45 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1" returned: 0 in 0.396s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-b3faf1ef-a849-4459-801f-42bcae5bf4d1" released by "_copy_volume_from_snapshot" :: held 3.945s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-a68701f3-72de-42ab-a672-085e7185f215" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-a68701f3-72de-42ab-a672-085e7185f215" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Deleting offline snapshot a68701f3-72de-42ab-a672-085e7185f215 of volume 23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] snapshot_file for this snap is: volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5181c19-a6b4-4b51-b29d-d72805150af2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:45 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:45 devstack sudo[91062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215
Apr 06 16:59:45 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:46 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215" returned: 0 in 0.469s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:46 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23169efa-c30a-48a8-89e0-da24c1dcd554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:46 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a72593-7f9b-45a0-9a6b-81cc19d001bb]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:46 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:46 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:46 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:46 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:46 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215
Apr 06 16:59:46 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:47 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215" returned: 0 in 0.433s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:47 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215
Apr 06 16:59:47 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:47 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554.a68701f3-72de-42ab-a672-085e7185f215" returned: 0 in 0.389s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-a68701f3-72de-42ab-a672-085e7185f215" released by "_delete_snapshot" :: held 1.802s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.730s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.800s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361222312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e7b4e0-cee3-46c3-9c2f-c96807c9dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb21c0d70e9f445e8b3e0261de81c5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:35Z,use_quota=True,user_id='a45bb9770f8e448f9e34f4548c095a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Creating volume 10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:47 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edee34b9-0304-4069-b13a-6183932c6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1', 'volume_size': 1, 'source_volid': '23169efa-c30a-48a8-89e0-da24c1dcd554', 'source_volstatus': 'available'}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:47 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 1073741824
Apr 06 16:59:47 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd0becf-edc9-4da2-b22d-0d23f23c88b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:47 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Volume volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 (b3faf1ef-a849-4459-801f-42bcae5bf4d1): created successfully
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd0becf-edc9-4da2-b22d-0d23f23c88b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:47 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Flow 'volume_create_manager' (01ff983f-89b8-4620-9d48-42e4d5e04bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:47 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-33f7e857-c3b1-4c80-a63b-1210ae7d3b7d tempest-VolumeDependencyTests-690672778 None] Created volume successfully.
Apr 06 16:59:47 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 1073741824" returned: 0 in 0.477s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:48 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14
Apr 06 16:59:48 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-23169efa-c30a-48a8-89e0-da24c1dcd554-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Lock "cinder-23169efa-c30a-48a8-89e0-da24c1dcd554-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-23169efa-c30a-48a8-89e0-da24c1dcd554" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-23169efa-c30a-48a8-89e0-da24c1dcd554" acquired by "delete_volume" :: waited 0.014s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc960dc-5f02-4ca3-a89c-7c64f05de599]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:48 devstack sudo[91087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:48 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:48 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14" returned: 0 in 0.439s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.047s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6e1617ef80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-06T14:59:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-518658388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec78dc9b-f46f-4c94-84d7-c5afe70fb62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f072b0023d49aa99831960b2d39e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-06T14:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-06T14:59:35Z,use_quota=True,user_id='4194d1da409e480a955f3e84a781a5e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87d55f4-4c06-4082-8924-f9dd1c467d8d),volume_type_id=e87d55f4-4c06-4082-8924-f9dd1c467d8d)}" {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Creating volume ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Selected osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240 as target Quobyte volume. {{(pid=82421) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 06 16:59:48 devstack cinder-volume[82421]: INFO cinder.volume.drivers.remotefs [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] casted to osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e 1073741824 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9632910-d568-44ea-97e4-261c0e9de41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c9cebd-2ed8-482d-85d7-79a528034e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:48 devstack sudo[91090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e 1073741824
Apr 06 16:59:48 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:48 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Volume volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 (10e7b4e0-cee3-46c3-9c2f-c96807c9dc14): created successfully
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c9cebd-2ed8-482d-85d7-79a528034e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Flow 'volume_create_manager' (e89b6051-1e62-4e0d-8b79-96aed235b467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:48 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-c47c9e70-c618-4284-8712-a10a1976a1ee tempest-CreateVolumesFromSnapshotTest-653775171 None] Created volume successfully.
Apr 06 16:59:48 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:48 devstack sudo[91095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554
Apr 06 16:59:48 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:48 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e 1073741824" returned: 0 in 0.452s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:48 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:48 devstack sudo[91100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e
Apr 06 16:59:48 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:49 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-23169efa-c30a-48a8-89e0-da24c1dcd554" returned: 0 in 0.418s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-23169efa-c30a-48a8-89e0-da24c1dcd554" released by "delete_volume" :: held 0.922s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Created reservations ['b4c562d0-52f1-456f-b0bd-427544ff7300', 'f861e4ea-c553-4c02-86d3-87d064ec9e59', '2f85a1f4-31ba-454c-b378-80845c944a20', '66123d6b-b529-4cd5-a0cc-a234e2a49ff5'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:49 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:49 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-b3faf1ef-a849-4459-801f-42bcae5bf4d1-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:49 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'} {{(pid=82421) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705a0cb2-377b-4a61-a963-6224b854f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e', 'volume_size': 1}' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b2ce67-4ef1-4a8d-bda9-1fc4cc21ea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-b3faf1ef-a849-4459-801f-42bcae5bf4d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:49 devstack cinder-volume[82421]: INFO cinder.volume.flows.manager.create_volume [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Volume volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e (ec78dc9b-f46f-4c94-84d7-c5afe70fb62e): created successfully
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b2ce67-4ef1-4a8d-bda9-1fc4cc21ea5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82421) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Flow 'volume_create_manager' (2f728418-af01-47af-ab4e-a698c17c97b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82421) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 06 16:59:49 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6270b396-74a8-4304-a775-bcbd96089cba tempest-CinderUnicodeTest-584790202 None] Created volume successfully.
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-b3faf1ef-a849-4459-801f-42bcae5bf4d1" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-b3faf1ef-a849-4459-801f-42bcae5bf4d1" acquired by "delete_volume" :: waited 0.006s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163a47d-45fe-4f6c-ac00-6e0849f5272f]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:49 devstack sudo[91106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1
Apr 06 16:59:49 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d6fb66-23b5-43d2-b709-bd0425a17d12]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:49 devstack sudo[91108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14
Apr 06 16:59:49 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:49 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:49 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Deleted volume successfully.
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-f43df61e-6647-423c-8018-5880b852d6ee tempest-VolumeDependencyTests-690672778 None] Lock "cinder-23169efa-c30a-48a8-89e0-da24c1dcd554-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:49 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1" returned: 0 in 0.473s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:49 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:49 devstack sudo[91114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1
Apr 06 16:59:49 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14" returned: 0 in 0.478s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack sudo[91119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14
Apr 06 16:59:50 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Creating offline snapshot 0129ebbd-3868-4f42-9600-049ba91d7f1a of volume ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a30d2-06c4-463b-b9d6-df6ffc1e64c5]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-b3faf1ef-a849-4459-801f-42bcae5bf4d1" returned: 0 in 0.406s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-b3faf1ef-a849-4459-801f-42bcae5bf4d1" released by "delete_volume" :: held 0.900s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:50 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e
Apr 06 16:59:50 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Created reservations ['ec2d8493-584e-428c-acd2-c27d97a670d0', '12c3bc76-e28e-44f9-aa83-adf7e3115afe', 'a549dea9-18dc-43a1-a23c-a5f7f4b370e5', '45b76469-c220-4006-8120-421db8bc3465'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack sudo[91124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:50 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14" returned: 0 in 0.404s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14" released by "delete_volume" :: held 0.906s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "cinder-quobyte-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['8b075159-c407-4b30-a7f1-c81dbf9228ef', '9baedf66-98f2-4d84-b96b-e3ef086b0005', 'aa475b07-3bdb-4b16-aaa9-3c35d4b49f61', '1b2a6f9e-4438-41f0-8a2d-462ac64f75f6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" acquired by "delete_volume" :: waited 0.023s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db1081-f887-4902-8faf-648e49c9c4b1]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-ce80bfeb-7db6-4508-a4d3-9163d479088c-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-ce80bfeb-7db6-4508-a4d3-9163d479088c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:50 devstack sudo[91131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:50 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-ce80bfeb-7db6-4508-a4d3-9163d479088c" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-ce80bfeb-7db6-4508-a4d3-9163d479088c" acquired by "delete_volume" :: waited 0.020s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:50 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24
Apr 06 16:59:50 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aef9750-1d34-4e6f-972e-96de6d76f7a0]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" returned: 0 in 0.525s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a 1G {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:50 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a 1G
Apr 06 16:59:50 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack sudo[91134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c
Apr 06 16:59:50 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:50 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.501s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:50 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Deleted volume successfully.
Apr 06 16:59:50 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-386c9564-67fa-468f-90ed-4be775b8bc24 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-b3faf1ef-a849-4459-801f-42bcae5bf4d1-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:51 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.465s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:51 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleted volume successfully.
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-908690d6-d42c-439b-9edc-b866c70b6a29 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-10e7b4e0-cee3-46c3-9c2f-c96807c9dc14-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:51 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" returned: 0 in 0.619s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:51 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24
Apr 06 16:59:51 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:51 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c" returned: 0 in 0.516s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:51 devstack sudo[91151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c
Apr 06 16:59:51 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:51 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a 1G" returned: 0 in 0.540s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:51 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a
Apr 06 16:59:51 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:51 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" returned: 0 in 0.414s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-quobyte-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24" released by "delete_volume" :: held 1.056s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:51 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ce80bfeb-7db6-4508-a4d3-9163d479088c" returned: 0 in 0.400s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Created reservations ['cdbcc54b-bee4-4f54-b50e-cb46b93a7907', '39eac6c8-a787-49fd-a4e2-76d9b26eca2f', '20909432-0a38-47dc-82e1-f5c3a00d2201', 'd542653d-0379-4e83-857f-dc78ce1fbee6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-ce80bfeb-7db6-4508-a4d3-9163d479088c" released by "delete_volume" :: held 0.959s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:51 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e -F qcow2 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a" returned: 0 in 0.427s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:51 devstack sudo[91160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:51 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a is being set with open permissions: ugo+rw
Apr 06 16:59:51 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['0a23e86c-a375-485a-9ed2-cc16fe8cce45', 'c84e77e3-ec9c-4365-8ab1-2f9d6c33eb1e', 'e083037e-1257-49d0-bd12-0a38bff12857', '85e687e8-4683-4dad-887f-c4abddfe0504'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:51 devstack sudo[91162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a
Apr 06 16:59:51 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:51 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:51 devstack sudo[91164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:51 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:52 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:52 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Deleted volume successfully.
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6d48470a-eaa7-4eb1-ae30-a67730ffd838 tempest-VolumeDependencyTests-690672778 None] Lock "cinder-2f3e7a8f-f0b8-4ca5-af3e-7da21657cc24-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:52 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a" returned: 0 in 0.412s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:52 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info
Apr 06 16:59:52 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:52 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:52 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleted volume successfully.
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-cf0f1db8-fef8-45c4-ab0e-0176809e84d7 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-ce80bfeb-7db6-4508-a4d3-9163d479088c-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:52 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:52 devstack cinder-volume[82421]: WARNING cinder.volume.drivers.remotefs [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info is being set with open permissions: ugo+rw
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:52 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info
Apr 06 16:59:52 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-5532ccc3-26ba-49c3-b2bd-e21588182817-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-5532ccc3-26ba-49c3-b2bd-e21588182817-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-5532ccc3-26ba-49c3-b2bd-e21588182817" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-5532ccc3-26ba-49c3-b2bd-e21588182817" acquired by "delete_volume" :: waited 0.009s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[725cf331-b19c-47c4-87f9-c9d507b1451b]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:52 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.info" returned: 0 in 0.394s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:52 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:52 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817
Apr 06 16:59:52 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:53 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-16b3493f-d6df-4c63-88a2-6c46dce393d1 tempest-CinderUnicodeTest-584790202 None] Create snapshot completed successfully
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-0129ebbd-3868-4f42-9600-049ba91d7f1a-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:53 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-0129ebbd-3868-4f42-9600-049ba91d7f1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-quobyte-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817" returned: 0 in 0.493s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-quobyte-0129ebbd-3868-4f42-9600-049ba91d7f1a" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:53 devstack sudo[91181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817
Apr 06 16:59:53 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-0129ebbd-3868-4f42-9600-049ba91d7f1a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Deleting offline snapshot 0129ebbd-3868-4f42-9600-049ba91d7f1a of volume ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] snapshot_file for this snap is: volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[62739f1f-e723-40c0-8e4b-bf3385409bd0]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:53 devstack sudo[91185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a
Apr 06 16:59:53 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:53 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5532ccc3-26ba-49c3-b2bd-e21588182817" returned: 0 in 0.426s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-5532ccc3-26ba-49c3-b2bd-e21588182817" released by "delete_volume" :: held 0.953s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['fc664745-c1ac-40b9-874d-6ba37dd6eb9a', '7132bc1c-319d-4fe8-bdb4-2d497a9a1b83', 'adef87af-383e-41ed-aba2-1540a340353c', 'e2ccc35e-5a66-40d0-ac2c-13b284638805'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:53 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:53 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:53 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a" returned: 0 in 0.513s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-e306786b-a352-4aba-8612-7a8a8811b740-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:53 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6caf316-eb9f-48db-a8f7-f6f2faa78198]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-e306786b-a352-4aba-8612-7a8a8811b740-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-e306786b-a352-4aba-8612-7a8a8811b740" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-e306786b-a352-4aba-8612-7a8a8811b740" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519704b-1832-48aa-8342-5789733cde4e]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:54 devstack sudo[91193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e
Apr 06 16:59:54 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:54 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740
Apr 06 16:59:54 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:54 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.435s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:54 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleted volume successfully.
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-2453c7f9-ba88-4dab-8d2c-4aec0eba8e1e tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-5532ccc3-26ba-49c3-b2bd-e21588182817-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:54 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" returned: 0 in 0.467s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:54 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a
Apr 06 16:59:54 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:54 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740" returned: 0 in 0.483s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:54 devstack sudo[91206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740
Apr 06 16:59:54 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:54 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:54 devstack sudo[91212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a
Apr 06 16:59:54 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:54 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-e306786b-a352-4aba-8612-7a8a8811b740" returned: 0 in 0.402s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-e306786b-a352-4aba-8612-7a8a8811b740" released by "delete_volume" :: held 0.910s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:54 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['1a9d9e7e-fad8-4290-808a-1c0a085ba56b', 'e5d891f5-4ae1-4cef-a478-e49fbbbc11a2', '860e5c26-d06e-4ddc-9437-73523750b3f7', 'ac4fbd13-1bd5-4cd7-9ed0-2633f0df1fca'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:55 devstack sudo[91214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:55 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a736213-a0ba-48f3-8c0d-109c47231da4]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:55 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7
Apr 06 16:59:55 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:55 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e.0129ebbd-3868-4f42-9600-049ba91d7f1a" returned: 0 in 0.406s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-0129ebbd-3868-4f42-9600-049ba91d7f1a" released by "_delete_snapshot" :: held 1.895s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" released by "delete_snapshot" :: held 1.913s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Created reservations ['2c8a956f-9aef-454d-a684-d778502ab403', '57a719b3-25a0-486e-8489-ad4f02b7d7f4', 'a9c13664-3806-44cf-9b9c-68167bbcc40e', '9aa0430f-14c5-4953-8cb0-e116ac4216f5'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:55 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Delete snapshot completed successfully.
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-09197181-beec-4d0f-bcc2-2c2e2f1f3f8e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-0129ebbd-3868-4f42-9600-049ba91d7f1a-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:55 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:55 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleted volume successfully.
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-52ea80f9-9d68-4125-b404-2e316985d988 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-e306786b-a352-4aba-8612-7a8a8811b740-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Lock "cinder-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-quobyte-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" acquired by "delete_volume" :: waited 0.008s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d0e6a-a90c-48fd-87b2-6b6d587b58bc]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:55 devstack sudo[91223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e
Apr 06 16:59:55 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:55 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7" returned: 0 in 0.480s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:55 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:55 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7
Apr 06 16:59:55 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:56 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e
Apr 06 16:59:56 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:56 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7" returned: 0 in 0.393s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7" released by "delete_volume" :: held 0.897s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['e7932ef8-c524-4688-a566-4c1a4dacd7f0', 'b900c686-ec14-4ca7-8918-d609d9e0df01', '5b2c76b7-c017-458f-95e7-5130ca6ebf02', '66c20228-0a43-4d13-a896-933f1697ce9b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:56 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:56 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc-delete_snapshot" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-0b52c7c4-937d-45d6-ae44-46eaa5115d50" by "delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-0b52c7c4-937d-45d6-ae44-46eaa5115d50" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" by "_delete_snapshot" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleting offline snapshot 2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc of volume 0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] snapshot_file for this snap is: volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc {{(pid=82421) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[5411a98d-d1b1-49d0-b526-e5599da38ed2]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:56 devstack sudo[91235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc
Apr 06 16:59:56 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" returned: 0 in 0.413s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e" released by "delete_volume" :: held 0.905s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Created reservations ['aaa11c7a-d25c-49dc-9275-982247a585cb', 'b0796dbf-cbbb-49fd-a031-81d56608f7c4', 'de206f90-e4a9-4b12-819a-5f5bcb39eb6f', '8e25e2cd-cca2-48a2-b6b3-8e4792ffc7e6'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:56 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.409s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:56 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:56 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleted volume successfully.
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-9024f6b1-de8f-4db0-97c6-290535b0e6c1 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-5e4575f2-f2cb-4617-b9d1-68d2aa1a4ce7-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-dce5ee89-5995-4b2c-a82a-cb85211d00a8-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-dce5ee89-5995-4b2c-a82a-cb85211d00a8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Acquiring lock "cinder-quobyte-dce5ee89-5995-4b2c-a82a-cb85211d00a8" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-dce5ee89-5995-4b2c-a82a-cb85211d00a8" acquired by "delete_volume" :: waited 0.012s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b397a0-d012-4201-8a1e-ae325f3f375a]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:56 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" returned: 0 in 0.476s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.remotefs [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82421) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 06 16:59:56 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8
Apr 06 16:59:56 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d091e8-8f81-4e69-9ed3-1aca7c1aa071]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:56 devstack sudo[91246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50
Apr 06 16:59:56 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:56 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.416s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:56 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Deleted volume successfully.
Apr 06 16:59:56 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-a979af39-eb68-465b-8bb0-db40b78d8737 tempest-CinderUnicodeTest-584790202 None] Lock "cinder-ec78dc9b-f46f-4c94-84d7-c5afe70fb62e-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:57 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8" returned: 0 in 0.444s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:57 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8
Apr 06 16:59:57 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:57 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50" returned: 0 in 0.466s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:57 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc
Apr 06 16:59:57 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:57 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-dce5ee89-5995-4b2c-a82a-cb85211d00a8" returned: 0 in 0.399s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-quobyte-dce5ee89-5995-4b2c-a82a-cb85211d00a8" released by "delete_volume" :: held 0.865s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Created reservations ['1cb11fe5-16c7-4a98-87f6-a18b3029ef0e', 'b62376e0-755a-45be-acb1-7872f1fb6a61', 'f1e575bf-fd33-4328-a072-3bc145fdcda9', '07e41209-c1f5-4de5-9f09-7fbc9de9ac8d'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:57 devstack sudo[91263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:57 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:57 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" returned: 0 in 0.457s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:57 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:57 devstack sudo[91265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc
Apr 06 16:59:57 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:58 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.425s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:58 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Deleted volume successfully.
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-0d0d5369-fb72-4eb2-b18d-77220376e63e tempest-CinderUnicodeTest-584790202 None] Lock "cinder-dce5ee89-5995-4b2c-a82a-cb85211d00a8-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:58 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50.2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" returned: 0 in 0.450s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc" released by "_delete_snapshot" :: held 1.904s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-0b52c7c4-937d-45d6-ae44-46eaa5115d50" released by "delete_snapshot" :: held 1.915s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['7e804031-03e8-4f77-bc39-286b0dd45ebc', 'a500343b-2265-45eb-8572-2cf6b55481bc', 'fb5bac45-d8f8-4ed4-bb01-c71a5a9a05af', '9d4c19b5-682f-427a-9c6e-245576924e4b'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:58 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Delete snapshot completed successfully.
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-05e334f2-b575-4e86-8197-750734e9f21d tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-2ccbbd2f-2899-4fe5-8cb9-6f176a8e2dbc-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-0b52c7c4-937d-45d6-ae44-46eaa5115d50-delete_volume" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-0b52c7c4-937d-45d6-ae44-46eaa5115d50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "cinder-quobyte-0b52c7c4-937d-45d6-ae44-46eaa5115d50" by "delete_volume" {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-0b52c7c4-937d-45d6-ae44-46eaa5115d50" acquired by "delete_volume" :: waited 0.017s {{(pid=82421) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d74a3-210b-4a35-a752-7a3d268a0e08]: (4, 'qcow2') {{(pid=83519) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:58 devstack sudo[91269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50
Apr 06 16:59:58 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:58 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50" returned: 0 in 0.468s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:58 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:58 devstack sudo[91274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50
Apr 06 16:59:58 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:59 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2/volume-0b52c7c4-937d-45d6-ae44-46eaa5115d50" returned: 0 in 0.392s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-quobyte-0b52c7c4-937d-45d6-ae44-46eaa5115d50" released by "delete_volume" :: held 0.897s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG cinder.quota [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Created reservations ['3eae64f9-07e2-47b5-b81f-48a0b4cedf43', 'f7238f93-58df-4b76-b692-ee81da09d0f4', 'fecb7100-9521-4c76-9c5d-80219b746d0b', 'f4100849-d984-4f1a-ab8f-df6470bad2ee'] {{(pid=82421) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 16:59:59 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 16:59:59 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 16:59:59 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.437s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 16:59:59 devstack cinder-volume[82421]: INFO cinder.volume.manager [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Deleted volume successfully.
Apr 06 16:59:59 devstack cinder-volume[82421]: DEBUG cinder.coordination [None req-6bdb9995-4592-44cc-858a-4817417aacc6 tempest-CreateVolumesFromSnapshotTest-653775171 None] Lock "cinder-0b52c7c4-937d-45d6-ae44-46eaa5115d50-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82421) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG oslo_service.periodic_task [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82421) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240': None} {{(pid=82421) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG cinder.volume.drivers.quobyte [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2fbccdf-032d-46dd-85f5-129f87053240'] {{(pid=82421) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.lockutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82421) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 06 17:00:03 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2 {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 06 17:00:03 devstack sudo[91285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2
Apr 06 17:00:03 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 06 17:00:04 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root
Apr 06 17:00:04 devstack cinder-volume[82421]: DEBUG oslo_concurrency.processutils [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9fca624e26e85839faa2b91784884c2" returned: 0 in 0.386s {{(pid=82421) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 06 17:00:04 devstack cinder-volume[82421]: DEBUG cinder.manager [None req-5a125f18-c0d2-47dd-9b61-33cb365f5728 None None] Notifying Schedulers of capabilities ... {{(pid=82421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 06 17:00:09 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=126,cinder:INSERT=56,cinder:UPDATE=204,cinder:DELETE=16 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 06 17:00:09 devstack cinder-volume[82421]: DEBUG dbcounter [-] [82421] Writing DB stats cinder:SELECT=138,cinder:INSERT=38,cinder:UPDATE=168,cinder:DELETE=14 {{(pid=82421) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}